00000001:02000400:0.0F:1788271497.201774:0:2952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788271507.875453:0:3155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788271509.106112:0:3200:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 703 MB/s 00000001:01000000:1.0F:1788271509.355823:0:3200:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 747 MB/s 00000001:01000000:1.0:1788271509.605601:0:3200:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5707 MB/s 00000020:02000000:3.0:1788271510.227348:0:3247:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_64_g65721f0 00000400:02000000:2.0F:1788271510.770658:0:3262:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.101@tcp [8/256/0/180] 00008000:02000000:1.0:1788271513.638485:0:3411:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788271577.201785:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788271596.179383:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788271596.179390:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788271596.179526:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000626c1ee1 00000080:02000400:2.0:1788271596.179538:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788271596.211263:0:5818:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788271596.211278:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788271596.211318:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005ab2dc2a) 00000020:00000080:0.0:1788271596.211383:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788271596.291913:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788271596.296086:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788271596.450292:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788271596.450330:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788271596.450350:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788271596.450398:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788271596.450451:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788271596.462756:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788271596.462770:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788271596.462786:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f6e97 00000020:01000004:3.0:1788271596.462797:0:5818:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788271596.462801:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788271596.462808:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000626c1ee1 from MGS 00000020:01000004:3.0:1788271596.462813:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788271596.462849:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dfa41d1c) 00000020:00000080:3.0:1788271596.462867:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788271596.462971:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000626c1ee1 from MGS, refs=2 00080000:01000000:3.0:1788271596.462976:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788271596.462981:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f6ea5 00000100:00100000:3.0:1788271596.463099:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788271596.463230:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788271596.463235:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788271596.475240:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788271596.475254:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788271596.482259:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271596.482503:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788271596.482510:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788271596.488510:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788271596.488523:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788271596.493447:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788271596.493461:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788271596.494347:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271596.494351:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271596.494353:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271596.498318:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271596.498324:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271596.498327:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271596.499646:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788271596.501949:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788271596.750716:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1007 MB/s 00000001:01000000:2.0:1788271597.015662:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 773 MB/s 00000001:01000000:0.0:1788271597.278034:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 133 MB/s 00000001:01000000:3.0:1788271597.538846:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 299 MB/s 00080000:10000000:3.0:1788271597.546978:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1788271597.555736:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788271597.558680:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788271597.558697:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788271597.558700:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788271597.566203:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788271597.566307:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788271597.566361:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788271597.566758:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788271597.566785:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788271597.567178:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271597.567327:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788271597.567333:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788271597.567957:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788271597.567963:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788271597.568406:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788271597.568529:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788271597.569088:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788271597.569109:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.101@tcp' 00000020:01000004:0.0:1788271597.569111:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788271597.569158:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.101@tcp (typ=mgc) 00000020:00000080:0.0:1788271597.569176:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.101@tcp (0000000036959540) 00000020:00000080:0.0:1788271597.569192:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788271597.569266:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005171603f@MGC192.168.201.101@tcp: add connection 192.168.201.101@tcp at head 00010000:00010000:0.0:1788271597.569404:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.101@tcp-0 is initialized 00000040:01000000:0.0:1788271597.569432:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788271597.571598:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788271597.572640:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788271597.572719:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.101@tcp (uuid e92ad5e1-0f38-442e-8a6a-19627f637d27) 00000020:00000080:2.0:1788271597.572742:0:5818:0:(genops.c:1385:class_connect()) connect: client e92ad5e1-0f38-442e-8a6a-19627f637d27, cookie 0xbeb05ca97b5f6eb3 00000100:00080000:2.0:1788271597.572753:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271597.572759:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import 000000005171603f using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271597.572933:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000de36a910 x1875138586869888/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271597.573077:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de36a910 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e92ad5e1-0f38-442e-8a6a-19627f637d27:3277:1875138586869888:0@lo:250: 00000100:00100000:3.0:1788271597.573167:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271597.578467:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586869888 00000100:00100000:0.0:1788271597.578496:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586869888 00000100:00100000:0.0:1788271597.578553:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271597.578561:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8201b21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875138586869888:12345-0@lo:250: 00010000:00080000:0.0:1788271597.578590:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e92ad5e1-0f38-442e-8a6a-19627f637d27@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1788271597.578624:0:5830:0:(genops.c:1385:class_connect()) connect: client e92ad5e1-0f38-442e-8a6a-19627f637d27, cookie 0xbeb05ca97b5f6eba 00000100:00080000:0.0:1788271597.578765:0:5830:0:(import.c:65:import_set_state_nolock()) 000000005dac721f : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788271597.580895:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS 00000020:01000004:2.0:1788271597.580926:0:5818:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788271597.580932:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788271597.580947:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fcfd348e) 00000020:00000080:2.0:1788271597.580962:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788271597.656869:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8201b21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:3277:x1875138586869888:12345-0@lo:250: Request processed in 78301us (83695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271597.656988:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271597.672597:0:3277:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788271597.672632:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.101@tcp: connect to target with instance 0 00000100:00080000:3.0:1788271597.672642:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788271597.672647:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788271597.672652:0:3277:0:(import.c:65:import_set_state_nolock()) 000000005171603f MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788271597.672656:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788271597.672670:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788271597.672677:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de36a910 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e92ad5e1-0f38-442e-8a6a-19627f637d27:3277:1875138586869888:0@lo:250: 00000100:00100000:0.0:1788271597.690327:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271597.690804:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788271597.690810:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788271597.696569:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788271597.696582:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788271597.697121:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788271597.697135:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788271597.698069:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271597.698254:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788271597.698267:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788271597.698989:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788271597.699462:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788271597.767854:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271597.768801:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788271597.768809:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788271597.773712:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788271597.773731:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788271597.779601:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271597.779812:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788271597.779819:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788271597.783243:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788271597.783260:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788271597.788365:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271597.788667:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788271597.788673:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788271597.790355:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788271597.790366:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788271597.790941:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271597.791164:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788271597.791169:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788271597.796118:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788271597.796926:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788271597.814793:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271597.815010:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788271597.815017:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788271597.835104:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788271597.835120:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788271597.844574:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788271597.844588:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788271597.855627:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788271597.856235:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788271597.856242:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788271597.856363:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788271597.856397:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788271597.856401:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788271597.856403:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788271597.856404:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271597.856405:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271597.856406:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271597.856408:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271597.856409:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271597.856457:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788271597.856465:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271597.856466:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271597.856467:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271597.856468:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271597.856471:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788271597.856473:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788271597.856474:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788271597.856475:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271597.856476:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271597.856477:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271597.856478:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271597.856479:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271597.856479:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788271597.856480:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271597.856481:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271597.856482:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271597.856483:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271597.856517:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788271597.856534:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870016:0@lo:253: 00000100:00100000:0.0:1788271597.856602:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271597.856644:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fcd17faa going to sleep for 11 seconds 00000100:00100000:3.0:1788271597.856840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870016 00000100:00100000:3.0:1788271597.856848:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870016 00000100:00100000:3.0:1788271597.856888:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271597.856895:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d9b110c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:5818:x1875138586870016:12345-0@lo:253: 20000000:01000000:3.0:1788271597.856938:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788271597.856940:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788271597.857090:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788271597.857113:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788271597.857364:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271597.862672:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788271597.863168:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788271597.863172:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788271597.863178:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788271597.863181:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788271597.863194:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788271597.863469:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271597.864494:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788271597.864512:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788271597.864561:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788271597.864609:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788271597.866005:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788271597.866192:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788271597.866202:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788271597.866285:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788271597.866295:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788271597.866329:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788271597.866336:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788271597.868869:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788271597.868952:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788271597.869014:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788271597.869021:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788271597.869054:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271597.869288:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788271597.869299:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788271597.869335:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788271597.872080:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788271597.872154:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788271597.872171:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788271597.872282:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788271597.872292:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788271597.875083:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788271597.875159:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788271597.875198:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788271597.875213:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788271597.875333:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788271597.875355:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788271597.875389:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788271597.875440:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788271597.875619:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788271597.879142:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788271597.879161:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788271597.880446:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788271597.880995:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788271597.881021:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.101@tcp for mdt 20000000:01000000:3.0:1788271597.881024:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788271597.881260:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788271597.881269:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788271597.881296:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788271597.881302:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:3.0:1788271597.881343:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788271597.881352:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788271597.881380:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788271597.881410:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788271597.881522:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788271597.881526:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788271597.881786:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788271597.881906:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788271597.885095:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788271597.885292:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788271597.910571:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788271597.910622:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788271597.910713:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788271597.910731:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788271597.910733:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788271597.910736:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788271597.910747:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788271597.910750:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788271597.910778:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788271597.910780:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788271597.914211:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788271597.915225:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788271597.915275:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788271597.915349:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1788271597.915365:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788271597.915367:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788271597.916276:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788271597.917140:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788271597.917182:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788271597.917213:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788271597.917227:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788271597.917229:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788271597.917235:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788271597.917261:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917276:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917286:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917291:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917296:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917301:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917306:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ba70f0a already unused, calling callback (00000000b5c99cbc) 00010000:00010000:1.0:1788271597.917309:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917315:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917325:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917331:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271597.917336:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6ec8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271597.917360:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788271598.372725:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d9b110c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:5818:x1875138586870016:12345-0@lo:253: Request processed in 515822us (516115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271598.372744:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271598.372869:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870016:0@lo:253: 10000000:01000000:0.0:1788271598.372883:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788271598.372886:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788271598.372888:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788271598.372890:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271598.372891:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788271598.372892:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271598.372893:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271598.372900:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271598.372902:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788271598.372903:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788271598.372905:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271598.372906:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788271598.372921:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000626c1ee1 from lustre-MDT0000 10000000:01000000:0.0:1788271598.372952:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788271598.372954:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788271598.372958:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ab6e59d0000 10000000:01000000:0.0:1788271598.372961:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271598.372968:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab6e59d0000 from 1 10000000:01000000:0.0:1788271598.372971:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788271598.373001:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 00000000f788dc0d/0xbeb05ca97b5f6ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.373012:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 00000000f788dc0d/0xbeb05ca97b5f6ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.373020:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 00000000f788dc0d/0xbeb05ca97b5f6ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271598.373036:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870144:0@lo:101: 00000100:00100000:0.0:1788271598.373066:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271598.373151:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd80c1d going to sleep for 11 seconds 00000100:00100000:3.0:1788271598.373237:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870144 00000100:00100000:3.0:1788271598.373244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870144 00000100:00100000:3.0:1788271598.373309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271598.373317:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002828afe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:5818:x1875138586870144:12345-0@lo:101: 00010000:00010000:3.0:1788271598.373328:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271598.373340:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f70b82c/0xbeb05ca97b5f6ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6ecf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271598.373358:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f70b82c/0xbeb05ca97b5f6ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271598.373367:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f70b82c/0xbeb05ca97b5f6ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271598.373375:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f70b82c, rc 0) 00000100:00100000:3.0:1788271598.373409:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002828afe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:5818:x1875138586870144:12345-0@lo:101: Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271598.373436:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271598.373498:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870144:0@lo:101: 00010000:00010000:0.0:1788271598.373509:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 00000000f788dc0d/0xbeb05ca97b5f6ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.373517:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 00000000f788dc0d/0xbeb05ca97b5f6ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271598.373554:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870272:0@lo:501: 00000100:00100000:0.0:1788271598.373582:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271598.373793:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd80c1d going to sleep for 11 seconds 00000100:00100000:1.0:1788271598.373825:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870272 00000100:00100000:1.0:1788271598.373829:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870272 00000100:00100000:2.0:1788271598.373876:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271598.373884:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0611cc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:5818:x1875138586870272:12345-0@lo:501: 00000100:00100000:2.0:1788271598.374080:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0611cc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:5818:x1875138586870272:12345-0@lo:501: Request processed in 197us (497us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271598.374094:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271598.374159:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870272:0@lo:501: 10000000:01000000:0.0:1788271598.374181:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788271598.374198:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 00000000f788dc0d/0xbeb05ca97b5f6ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374206:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 00000000f788dc0d/0xbeb05ca97b5f6ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271598.374212:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab6c9170000 10000000:01000000:0.0:1788271598.374216:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788271598.374219:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab6c9170000 10000000:01000000:0.0:1788271598.374221:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788271598.374224:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab6c9170000 from 1 10000000:01000000:0.0:1788271598.374226:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788271598.374240:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 0000000070220144/0xbeb05ca97b5f6edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374246:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 0000000070220144/0xbeb05ca97b5f6edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374253:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 0000000070220144/0xbeb05ca97b5f6edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271598.374262:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870400:0@lo:101: 00000100:00100000:0.0:1788271598.374284:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271598.374297:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd80c1d going to sleep for 11 seconds 00000100:00100000:0.0:1788271598.374309:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870400 00000100:00100000:0.0:1788271598.374317:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870400 00000100:00100000:0.0:1788271598.374332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271598.374336:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000973da6b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:5818:x1875138586870400:12345-0@lo:101: 00010000:00010000:0.0:1788271598.374343:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271598.374350:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000abcfe2b7/0xbeb05ca97b5f6ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6edd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374361:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abcfe2b7/0xbeb05ca97b5f6ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6edd expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374368:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000abcfe2b7/0xbeb05ca97b5f6ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6edd expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374376:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000abcfe2b7, rc 0) 00000100:00100000:0.0:1788271598.374398:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000973da6b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+7:5818:x1875138586870400:12345-0@lo:101: Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271598.374404:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271598.374457:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870400:0@lo:101: 00010000:00010000:0.0:1788271598.374465:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 0000000070220144/0xbeb05ca97b5f6edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374472:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 0000000070220144/0xbeb05ca97b5f6edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271598.374481:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788271598.374484:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 0000000070220144/0xbeb05ca97b5f6edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374489:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 0000000070220144/0xbeb05ca97b5f6edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271598.374500:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788271598.374503:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271598.374506:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab6c9170000 10000000:01000000:0.0:1788271598.374508:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788271598.374511:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788271598.374513:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788271598.374523:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000002ac1b682/0xbeb05ca97b5f6eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374529:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000002ac1b682/0xbeb05ca97b5f6eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374535:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000002ac1b682/0xbeb05ca97b5f6eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271598.374543:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870528:0@lo:101: 00000100:00100000:0.0:1788271598.374564:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271598.374575:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd80c1d going to sleep for 11 seconds 00000100:00100000:0.0:1788271598.374586:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870528 00000100:00100000:0.0:1788271598.374588:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870528 00000100:00100000:0.0:1788271598.374602:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271598.374606:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000145d46ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+7:5818:x1875138586870528:12345-0@lo:101: 00010000:00010000:0.0:1788271598.374612:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271598.374616:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000937e5d38/0xbeb05ca97b5f6ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6eeb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374627:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000937e5d38/0xbeb05ca97b5f6ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374704:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000937e5d38/0xbeb05ca97b5f6ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374711:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000937e5d38, rc 0) 00000100:00100000:0.0:1788271598.374736:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000145d46ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+8:5818:x1875138586870528:12345-0@lo:101: Request processed in 129us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271598.374741:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271598.374765:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870528:0@lo:101: 00010000:00010000:0.0:1788271598.374773:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000002ac1b682/0xbeb05ca97b5f6eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271598.374780:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000002ac1b682/0xbeb05ca97b5f6eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271598.374809:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870656:0@lo:501: 00000100:00100000:0.0:1788271598.374829:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271598.374840:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd80c1d going to sleep for 11 seconds 00000100:00100000:0.0:1788271598.374850:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870656 00000100:00100000:0.0:1788271598.374852:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870656 00000100:00100000:0.0:1788271598.374866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271598.374870:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026465c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+8:5818:x1875138586870656:12345-0@lo:501: 00000100:00100000:0.0:1788271598.375013:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026465c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5818:x1875138586870656:12345-0@lo:501: Request processed in 143us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271598.375020:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271598.375044:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870656:0@lo:501: 00000100:00100000:0.0:1788271598.375064:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870784:0@lo:503: 00000100:00100000:0.0:1788271598.375098:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271598.375108:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd80c1d going to sleep for 11 seconds 00000100:00100000:0.0:1788271598.375118:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870784 00000100:00100000:0.0:1788271598.375121:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870784 00000100:00100000:0.0:1788271598.375134:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271598.375139:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f97caa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5818:x1875138586870784:12345-0@lo:503: 00000100:00100000:0.0:1788271598.375257:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f97caa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5818:x1875138586870784:12345-0@lo:503: Request processed in 118us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271598.375263:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271598.375293:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586870784:0@lo:503: 00000100:00100000:2.0:1788271598.375853:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5862:1875138586870912:0@lo:502: 00000100:00100000:2.0:1788271598.375887:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271598.375916:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c631899e going to sleep for 11 seconds 00000100:00100000:0.0:1788271598.375999:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586870912 00000100:00100000:0.0:1788271598.376003:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586870912 00000100:00100000:0.0:1788271598.376029:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271598.376035:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ae11db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5862:x1875138586870912:12345-0@lo:502: 00000100:00100000:0.0:1788271598.376167:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ae11db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5862:x1875138586870912:12345-0@lo:502: Request processed in 132us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271598.376173:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788271598.376277:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5862:1875138586870912:0@lo:502: 00000020:01000000:2.0:1788271598.376297:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271598.376306:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271598.376309:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788271598.376313:0:5862:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788271598.376315:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271598.376328:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e6a80770) 00000020:00000080:2.0:1788271598.376342:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788271598.376346:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788271598.376410:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788271598.376432:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f6f00 00000020:00000080:2.0:1788271598.376634:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788271598.376769:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271598.376773:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271598.376774:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788271598.376777:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271598.376780:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271598.376781:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788271598.376840:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271598.376848:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000030e1e0ee) 00000020:00000080:2.0:1788271598.376857:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788271598.376861:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788271598.376862:0:5862:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788271598.376865:0:5862:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788271598.376870:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271598.376918:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000626c1ee1 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788271598.376938:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000449b033f) 00000020:00000080:2.0:1788271598.376945:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788271598.376993:0:5862:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788271598.376997:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f6f15 00000020:00000080:2.0:1788271598.377084:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788271598.377089:0:5862:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788271598.377092:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbeb05ca97b5f6f1c 00080000:01000000:2.0:1788271598.377096:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788271598.377099:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f6f23 00080000:10000000:2.0:1788271598.378505:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788271598.378756:0:5862:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788271598.386048:0:5862:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788271598.523864:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788271598.524172:0:5862:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788271598.527365:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788271598.528114:0:5862:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1788271598.578701:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788271598.603705:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c6265261) 00000020:00000080:2.0:1788271598.603729:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788271598.603800:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788271598.603807:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f6f31 00000020:00000080:2.0:1788271598.604779:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788271598.606167:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271598.679139:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271598.758196:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271598.837336:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271598.893189:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788271598.963608:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788271599.070610:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbeb05ca97b5f6f38 00000020:00000080:1.0:1788271599.072163:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788271599.072178:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271599.072185:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271599.072187:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788271599.072190:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271599.072196:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271599.072198:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788271599.072202:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788271599.072404:0:5862:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788271599.072464:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271599.072469:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271599.072470:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788271599.072472:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271599.072475:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271599.072476:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788271599.072478:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788271599.072480:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788271599.072537:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049f4ea58 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5862:1875138586871040:0@lo:502: 00000100:00100000:1.0:1788271599.072613:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271599.072734:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871040 00000100:00100000:0.0:1788271599.072741:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871040 00000100:00100000:0.0:1788271599.072797:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271599.072806:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed4259a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5862:x1875138586871040:12345-0@lo:502: 00000100:00100000:0.0:1788271599.078151:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed4259a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5862:x1875138586871040:12345-0@lo:502: Request processed in 5338us (5530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271599.078181:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271599.078790:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aee95c05 going to sleep for 11 seconds 00000100:00100000:2.0:1788271599.078823:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049f4ea58 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5862:1875138586871040:0@lo:502: 00000020:01000000:2.0:1788271599.078864:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271599.078882:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271599.078885:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271599.078890:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788271599.079358:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788271599.079379:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788271599.079400:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 000000002ac1b682/0xbeb05ca97b5f6eeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271599.079445:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 000000002ac1b682/0xbeb05ca97b5f6eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271599.079454:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6c9170000 from 1 10000000:01000000:0.0:1788271599.079457:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271599.079495:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271599.079502:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271599.079511:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271599.079530:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871168:0@lo:101: 00000100:00100000:0.0:1788271599.079579:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271599.080061:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871168 00000100:00100000:3.0:1788271599.080068:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871168 00000100:00100000:3.0:1788271599.080121:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271599.080129:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065185f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:5818:x1875138586871168:12345-0@lo:101: 00010000:00010000:3.0:1788271599.080157:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271599.080169:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6f3f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.080189:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.080198:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.080206:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd7c9d8c, rc 0) 00000100:00100000:3.0:1788271599.080373:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065185f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:5818:x1875138586871168:12345-0@lo:101: Request processed in 245us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271599.080380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271599.080506:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fab370ab going to sleep for 11 seconds 00000100:00100000:0.0:1788271599.080525:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871168:0@lo:101: 00010000:00010000:0.0:1788271599.080536:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271599.080544:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271599.101200:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871296:0@lo:256: 00000100:00100000:2.0:1788271599.101280:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.101344:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e166829 going to sleep for 11 seconds 00000100:00100000:0.0:1788271599.101742:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871296 00000100:00100000:0.0:1788271599.101751:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871296 00000100:00100000:0.0:1788271599.101816:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271599.101825:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f5a13e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:5818:x1875138586871296:12345-0@lo:256: 20000000:01000000:0.0:1788271599.101845:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788271599.101850:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788271599.101938:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f5a13e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:5818:x1875138586871296:12345-0@lo:256: Request processed in 114us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271599.102124:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871296:0@lo:256: 10000000:01000000:2.0:1788271599.102755:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788271599.102772:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.103060:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271599.103088:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c9170000 from 1 10000000:01000000:2.0:1788271599.103091:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271599.103126:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.103132:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.103141:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271599.103157:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871424:0@lo:101: 00000100:00100000:2.0:1788271599.103197:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.103220:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e166829 going to sleep for 11 seconds 00000100:00100000:3.0:1788271599.103345:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871424 00000100:00100000:3.0:1788271599.103351:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871424 00000100:00100000:3.0:1788271599.103377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271599.103384:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096c76485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5818:x1875138586871424:12345-0@lo:101: 00010000:00010000:3.0:1788271599.103393:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271599.103405:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6f4d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.103459:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.103470:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.103478:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000210bfc28, rc 0) 00000100:00100000:3.0:1788271599.103522:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096c76485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5818:x1875138586871424:12345-0@lo:101: Request processed in 138us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271599.103529:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271599.103615:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271599.104079:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871424:0@lo:101: 00010000:00010000:2.0:1788271599.104092:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.104099:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271599.104158:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871552:0@lo:501: 00000100:00100000:2.0:1788271599.104184:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.104209:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e166829 going to sleep for 11 seconds 00000100:00100000:3.0:1788271599.104258:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871552 00000100:00100000:3.0:1788271599.104262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871552 00000100:00100000:3.0:1788271599.104281:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788271599.104286:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005482bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5818:x1875138586871552:12345-0@lo:501: 00000100:00100000:3.0:1788271599.105097:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005482bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5818:x1875138586871552:12345-0@lo:501: Request processed in 809us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271599.105104:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271599.105272:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871552:0@lo:501: 00000100:00100000:2.0:1788271599.105300:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871680:0@lo:503: 00000100:00100000:2.0:1788271599.105341:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.105360:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e166829 going to sleep for 11 seconds 00000100:00100000:0.0:1788271599.106377:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871680 00000100:00100000:0.0:1788271599.106384:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871680 00000100:00100000:0.0:1788271599.106453:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271599.106461:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000104b33de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5818:x1875138586871680:12345-0@lo:503: 00000040:00080000:0.0:1788271599.106504:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788271599.106555:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000104b33de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5818:x1875138586871680:12345-0@lo:503: Request processed in 94us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271599.106561:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271599.106743:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871680:0@lo:503: 00000040:00080000:1.0:1788271599.107824:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788271599.108166:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788271599.108185:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271599.108198:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.108209:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271599.108248:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788271599.108250:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab6c9170000 10000000:01000000:2.0:1788271599.108253:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab6c9170000 10000000:01000000:2.0:1788271599.108257:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271599.108262:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c9170000 from 1 10000000:01000000:2.0:1788271599.108265:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788271599.108292:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 00000000e6adc061/0xbeb05ca97b5f6f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.108300:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 00000000e6adc061/0xbeb05ca97b5f6f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.108318:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 00000000e6adc061/0xbeb05ca97b5f6f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271599.108334:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871808:0@lo:101: 00000100:00100000:2.0:1788271599.108378:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.108477:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd9ec4ab going to sleep for 11 seconds 00000100:00100000:3.0:1788271599.108701:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871808 00000100:00100000:3.0:1788271599.108707:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871808 00000100:00100000:3.0:1788271599.108747:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271599.108755:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4740c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5818:x1875138586871808:12345-0@lo:101: 00010000:00010000:3.0:1788271599.108764:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271599.108786:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e67222cb/0xbeb05ca97b5f6f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6f5b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.108805:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e67222cb/0xbeb05ca97b5f6f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.108814:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e67222cb/0xbeb05ca97b5f6f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.108822:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e67222cb, rc 0) 00000100:00100000:3.0:1788271599.108856:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4740c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5818:x1875138586871808:12345-0@lo:101: Request processed in 103us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271599.108862:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271599.109311:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871808:0@lo:101: 00010000:00010000:2.0:1788271599.109324:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 00000000e6adc061/0xbeb05ca97b5f6f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.109332:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 00000000e6adc061/0xbeb05ca97b5f6f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271599.109376:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871936:0@lo:501: 00000100:00100000:2.0:1788271599.109403:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.109460:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd9ec4ab going to sleep for 11 seconds 00000100:00100000:0.0:1788271599.109509:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586871936 00000100:00100000:0.0:1788271599.109513:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586871936 00000100:00100000:0.0:1788271599.109544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271599.109550:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fab3479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5818:x1875138586871936:12345-0@lo:501: 00000100:00100000:0.0:1788271599.109796:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fab3479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5818:x1875138586871936:12345-0@lo:501: Request processed in 247us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271599.109804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271599.110105:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586871936:0@lo:501: 00000100:00100000:2.0:1788271599.110130:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586872064:0@lo:503: 00000100:00100000:2.0:1788271599.110166:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.110188:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd9ec4ab going to sleep for 11 seconds 00000100:00100000:1.0:1788271599.110303:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872064 00000100:00100000:1.0:1788271599.110314:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872064 00000100:00100000:1.0:1788271599.110346:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788271599.110352:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee3a5e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5818:x1875138586872064:12345-0@lo:503: 00000100:00100000:1.0:1788271599.110694:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee3a5e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5818:x1875138586872064:12345-0@lo:503: Request processed in 342us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271599.110702:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271599.111035:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd3c6f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586872064:0@lo:503: 00000100:00100000:2.0:1788271599.111542:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bd776c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5867:1875138586872192:0@lo:502: 00000100:00100000:2.0:1788271599.111581:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.111605:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f07e126 going to sleep for 11 seconds 00000100:00100000:1.0:1788271599.112016:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872192 00000100:00100000:1.0:1788271599.112021:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872192 00000100:00100000:1.0:1788271599.112053:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271599.112060:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000263383db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5867:x1875138586872192:12345-0@lo:502: 00000100:00100000:1.0:1788271599.112253:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000263383db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5867:x1875138586872192:12345-0@lo:502: Request processed in 194us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271599.112261:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271599.112322:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bd776c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5867:1875138586872192:0@lo:502: 00000020:01000004:3.0:1788271599.112370:0:5867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788271599.112382:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000099503f28) 00000020:00000080:3.0:1788271599.112398:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788271599.112496:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000626c1ee1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788271599.112500:0:5867:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000626c1ee1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788271599.112502:0:5867:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000626c1ee1 4 00010000:00080000:3.0:1788271599.112525:0:5867:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000059799827@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1788271599.119531:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788271599.125193:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788271599.125235:0:5867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788271599.125247:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbeb05ca97b5f6f70 00000100:00080000:3.0:1788271599.125257:0:5867:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271599.125263:0:5867:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000059799827 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1788271599.125308:0:5867:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a4374aaa x1875138586872320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271599.125338:0:5867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788271599.126042:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4374aaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586872320:0@lo:38: 00000100:00100000:2.0:1788271599.126114:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271599.128096:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872320 00000100:00100000:3.0:1788271599.128107:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872320 00000100:00100000:3.0:1788271599.128153:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271599.128160:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf68bcad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875138586872320:12345-0@lo:38: 00000100:00100000:3.0:1788271599.128296:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf68bcad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875138586872320:12345-0@lo:38: Request processed in 134us (2181us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788271599.128303:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271599.128467:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000420ab5c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5867:1875138586872448:0@lo:502: 00000100:00100000:3.0:1788271599.128521:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271599.128547:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872448 00000100:00100000:3.0:1788271599.128556:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872448 00000100:00100000:3.0:1788271599.128587:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271599.128592:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a072d91a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5867:x1875138586872448:12345-0@lo:502: 00000100:00100000:3.0:1788271599.128859:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a072d91a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5867:x1875138586872448:12345-0@lo:502: Request processed in 267us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271599.130281:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c44041ce going to sleep for 11 seconds 00000100:00100000:0.0:1788271599.130310:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000420ab5c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:5867:1875138586872448:0@lo:502: 00000040:00080000:0.0:1788271599.130349:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1788271599.130569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000020:01000000:3.0:1788271599.131461:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788271599.131483:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271599.131501:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 00000000e6adc061/0xbeb05ca97b5f6f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271599.131512:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 00000000e6adc061/0xbeb05ca97b5f6f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788271599.131556:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788271599.131559:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271599.131561:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271599.131562:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271599.131563:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271599.131564:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271599.131566:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271599.131567:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271599.131569:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271599.131570:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271599.131571:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271599.131572:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271599.131576:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788271599.131579:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788271599.131580:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271599.131581:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271599.131582:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271599.131583:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271599.131584:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271599.131585:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271599.131586:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271599.131592:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271599.131593:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271599.131594:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271599.131595:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271599.131618:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788271599.136128:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000223e6b69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586872576:0@lo:253: 00000100:00100000:3.0:1788271599.136205:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271599.136254:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000008dc2a28e going to sleep for 11 seconds 00000100:00100000:1.0:1788271599.143475:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872576 00000100:00100000:1.0:1788271599.143491:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872576 00000100:00100000:1.0:1788271599.143539:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788271599.143548:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036484c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5818:x1875138586872576:12345-0@lo:253: 20000000:01000000:1.0:1788271599.143586:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788271599.143599:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788271599.149067:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271599.149079:0:3277:0:(import.c:65:import_set_state_nolock()) 0000000059799827 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271599.149086:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788271599.149091:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4374aaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586872320:0@lo:38: 20000000:01000000:1.0:1788271599.206855:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788271599.206885:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788271599.207049:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788271599.207054:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788271599.207078:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.207097:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.207104:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.207146:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271599.207163:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271599.207176:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec29e2ed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875138586872704:0@lo:104: 00000100:00100000:2.0:1788271599.207239:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271599.207304:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e841c37c going to sleep for 11 seconds 00000100:00100000:0.0:1788271599.207512:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872704 00000100:00100000:0.0:1788271599.207520:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872704 00000100:00100000:0.0:1788271599.207570:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271599.207579:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009de57ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5853:x1875138586872704:12345-0@lo:104: 00010000:00010000:0.0:1788271599.207592:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271599.207657:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271599.207662:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009de57ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5853:x1875138586872704:12345-0@lo:104: Request processed in 86us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271599.207669:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788271599.207761:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271599.207766:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.207773:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000240c599 already unused, calling callback (000000006abd2428) 10000000:00010000:1.0:1788271599.207776:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.207800:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271599.207806:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271599.207811:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271599.207845:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.207852:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271599.207879:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.207886:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f46 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.207904:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271599.207906:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271599.207907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271599.207967:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b5eedb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586872832:0@lo:103: 00000100:00100000:1.0:1788271599.207997:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271599.208083:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872832 00000100:00100000:1.0:1788271599.208088:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872832 00010000:00010000:1.0:1788271599.208104:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 13 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271599.208125:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271599.208131:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e403a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3279:x1875138586872832:12345-0@lo:103: 00010000:00010000:1.0:1788271599.208146:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271599.208150:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 13 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208159:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 13 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208175:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208181:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271599.208193:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001139741s 00010000:00010000:1.0:1788271599.208196:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208201:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208206:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208212:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208216:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fcf5939 already unused, calling callback (00000000b5c99cbc) 00010000:00010000:1.0:1788271599.208220:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208225:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208239:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208248:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271599.208274:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e403a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3279:x1875138586872832:12345-0@lo:103: Request processed in 144us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271599.208281:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271599.208314:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b5eedb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586872832:0@lo:103: 00010000:00010000:1.0:1788271599.208340:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dd7c9d8c/0xbeb05ca97b5f6f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f3f expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271599.208349:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec29e2ed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875138586872704:0@lo:104: 00010000:00010000:1.0:1788271599.208358:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208365:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208369:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271599.208374:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008fcf5939/0xbeb05ca97b5f6f77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271599.222530:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036484c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5818:x1875138586872576:12345-0@lo:253: Request processed in 78975us (86317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271599.222552:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271599.222913:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000223e6b69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:5818:1875138586872576:0@lo:253: 10000000:01000000:3.0:1788271599.222928:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788271599.222931:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271599.222933:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271599.222935:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271599.222949:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271599.222950:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271599.222952:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271599.222953:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271599.222954:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271599.222955:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271599.222956:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271599.222958:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271599.222959:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788271599.222972:0:5818:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788271599.235351:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271599.235797:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271599.237105:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271599.237314:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271599.238227:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271599.238378:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271599.243506:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271599.244193:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271599.244456:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271599.244652:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271599.244904:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271599.245642:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788271599.313524:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788271599.339164:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788271599.339194:0:5872:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788271599.339198:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788271599.339621:0:5873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788271599.341800:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788271599.342134:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788271599.342749:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788271599.342757:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788271599.342876:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271599.344092:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788271599.344773:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788271599.344882:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788271599.345087:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788271599.345507:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788271599.347269:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788271599.347399:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788271599.347708:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788271599.347852:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788271599.347985:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788271599.348136:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788271599.348402:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788271599.348576:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788271599.348770:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788271599.348925:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788271599.349057:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788271599.349199:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788271599.349329:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788271599.349546:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788271599.349749:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788271599.349904:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788271599.350175:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788271599.350322:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788271599.350526:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788271599.350816:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788271599.350944:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788271599.351093:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788271599.351223:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788271599.351375:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788271599.351588:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788271599.351797:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788271599.351947:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788271599.352097:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788271599.352334:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788271599.352516:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788271599.352740:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788271599.352898:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788271599.353085:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788271599.380935:0:5873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788271599.425100:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788271599.425133:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa54081cb7988 00100000:10000000:0.0:1788271599.425141:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788271599.427147:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788271599.427163:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788271599.427176:0:5818:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788271599.427200:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788271599.461825:0:5873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788271599.461969:0:5873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788271599.461974:0:5873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788271599.612521:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271600.626493:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271601.663190:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271602.675177:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271603.698786:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788271604.213326:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788271604.213335:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788271604.213347:0:38:0:(import.c:65:import_set_state_nolock()) 0000000059799827 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271604.213361:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000059799827 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1788271604.213384:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005995e3c1 x1875138586873088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271604.213436:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005995e3c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586873088:0@lo:38: 00000100:00100000:1.0:1788271604.213439:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271604.213449:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000223e6b69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586872960:0@lo:400: 00000100:00100000:3.0:1788271604.219204:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271604.221521:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271604.221591:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873088 00000100:00100000:1.0:1788271604.221600:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873088 00000100:00100000:1.0:1788271604.221644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271604.221651:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002841d425 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875138586873088:12345-0@lo:38: 00010000:00080000:1.0:1788271604.221677:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1788271604.221714:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbeb05ca97b5f6f7e 00000004:00100000:1.0:1788271604.221759:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788271604.221887:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000e506c1a1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271604.221946:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002841d425 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875138586873088:12345-0@lo:38: Request processed in 294us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271604.221953:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788271604.222020:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005995e3c1 x1875138586873088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788271604.222035:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788271604.222042:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788271604.222046:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788271604.222048:0:3277:0:(import.c:65:import_set_state_nolock()) 0000000059799827 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788271604.222053:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005995e3c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586873088:0@lo:38: 00000100:00100000:3.0:1788271604.225938:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586872960 00000100:00100000:3.0:1788271604.225955:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586872960 00000100:00100000:3.0:1788271604.226027:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271604.226037:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029c49080 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:3281:x1875138586872960:12345-0@lo:400: 00000100:00100000:3.0:1788271604.226133:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029c49080 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:3281:x1875138586872960:12345-0@lo:400: Request processed in 97us (4618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271604.226141:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788271604.226205:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000223e6b69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586872960:0@lo:400: 00010000:00010000:1.0:1788271604.723746:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271604.861713:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788271605.749379:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788271606.770680:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788271606.770690:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6c9170000 from 3 10000000:01000000:0.0:1788271606.770695:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271606.770742:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271606.770755:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271606.770770:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271606.770805:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586873216:0@lo:101: 00000100:00100000:0.0:1788271606.770875:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271606.770937:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000193ebee2 going to sleep for 11 seconds 00000100:00100000:2.0:1788271606.771085:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873216 00000100:00100000:2.0:1788271606.771092:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873216 00000100:00100000:2.0:1788271606.771146:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271606.771155:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030fec7a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5834:x1875138586873216:12345-0@lo:101: 00010000:00010000:2.0:1788271606.771176:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271606.771189:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb1dfe55/0xbeb05ca97b5f6f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6f85 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271606.771211:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb1dfe55/0xbeb05ca97b5f6f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271606.771220:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb1dfe55/0xbeb05ca97b5f6f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271606.771230:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb1dfe55, rc 0) 00000100:00100000:2.0:1788271606.771275:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030fec7a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586873216:12345-0@lo:101: Request processed in 121us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271606.771282:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788271606.771405:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586873216:0@lo:101: 00010000:00010000:0.0:1788271606.771449:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271606.771468:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271606.771514:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586873344:0@lo:256: 00000100:00100000:0.0:1788271606.771544:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271606.771558:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000193ebee2 going to sleep for 11 seconds 00000100:00100000:3.0:1788271606.771611:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873344 00000100:00100000:3.0:1788271606.771615:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873344 00000100:00100000:3.0:1788271606.771639:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271606.771644:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cfe8daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586873344:12345-0@lo:256: 20000000:01000000:3.0:1788271606.771656:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788271606.771675:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788271606.771678:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788271606.771763:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cfe8daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586873344:12345-0@lo:256: Request processed in 118us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271606.771771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271606.774792:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586873344:0@lo:256: 10000000:01000000:0.0:1788271606.774870:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271606.774880:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271606.774889:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 000000000240c599/0xbeb05ca97b5f6f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271606.778068:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271607.795376:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271608.818558:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271609.331625:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271609.331654:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084d78a4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586873472:0@lo:400: 00000100:00100000:2.0:1788271609.331734:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271609.331814:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873472 00000100:00100000:3.0:1788271609.331823:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873472 00000100:00100000:3.0:1788271609.331871:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271609.331889:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000613f8d42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:3280:x1875138586873472:12345-0@lo:400: 00000100:00100000:2.0:1788271609.332019:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ace9e65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586873600:0@lo:400: 00000100:00100000:2.0:1788271609.332051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271609.337026:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873600 00000100:00100000:2.0:1788271609.337042:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873600 00000100:00100000:3.0:1788271609.337053:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000613f8d42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:3280:x1875138586873472:12345-0@lo:400: Request processed in 5172us (5316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271609.337066:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788271609.337101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271609.337108:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87d7777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586873600:12345-0@lo:400: 00000100:00100000:3.0:1788271609.337131:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084d78a4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586873472:0@lo:400: 00000100:00100000:2.0:1788271609.337173:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87d7777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586873600:12345-0@lo:400: Request processed in 65us (5121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271609.337178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788271609.337186:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007ace9e65 x1875138586873600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271609.337199:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ace9e65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586873600:0@lo:400: 00010000:00010000:3.0:1788271609.844786:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271610.875033:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788271611.107795:0:6319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0dd58990 20000000:00000080:2.0:1788271611.107871:0:6319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab6ee92a000 uarg=0000000000000000 20000000:01000000:2.0:1788271611.107905:0:6319:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788271611.107911:0:6319:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788271611.107916:0:6319:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788271611.108164:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788271611.108174:0:6319:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788271611.111770:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271611.112139:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788271611.112194:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788271611.112262:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788271611.112282:0:6319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788271611.112301:0:6319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271611.112321:0:6319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271611.112330:0:6319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271611.112366:0:6319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271611.112381:0:6319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 11 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271611.112395:0:6319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000fd6e316 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1875138586873728:0@lo:104: 00000100:00100000:2.0:1788271611.112584:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271611.112630:0:6319:0:(client.c:2715:ptlrpc_set_wait()) set 000000009115fbc6 going to sleep for 11 seconds 00000100:00100000:0.0:1788271611.112751:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873728 00000100:00100000:0.0:1788271611.112758:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873728 00000100:00100000:0.0:1788271611.112904:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271611.112914:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da44f30c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:6319:x1875138586873728:12345-0@lo:104: 00010000:00010000:0.0:1788271611.112927:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.112990:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271611.112995:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da44f30c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:6319:x1875138586873728:12345-0@lo:104: Request processed in 84us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271611.113002:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271611.113069:0:6319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000fd6e316 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1875138586873728:0@lo:104: 00010000:00010000:2.0:1788271611.113088:0:6319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.113637:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271611.113648:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.113655:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000018a40282 already unused, calling callback (000000006abd2428) 10000000:00010000:0.0:1788271611.113658:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.113665:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271611.113671:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271611.113676:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271611.113742:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.113748:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271611.113774:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.113779:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 0000000018a40282/0xbeb05ca97b5f6f4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f54 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.113795:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271611.113802:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271611.113803:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271611.113844:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586873856:0@lo:103: 00000100:00100000:1.0:1788271611.113880:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271611.114019:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873856 00000100:00100000:0.0:1788271611.114025:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873856 00010000:00010000:0.0:1788271611.114044:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 12 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271611.114090:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271611.114097:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b5eedb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:3279:x1875138586873856:12345-0@lo:103: 00010000:00010000:0.0:1788271611.114107:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271611.114111:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 12 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114120:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 12 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114131:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000210bfc28/0xbeb05ca97b5f6f54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f4d expref: 12 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114144:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114149:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114160:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114167:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114172:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114177:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114194:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000abf825cd already unused, calling callback (00000000b5c99cbc) 00010000:00010000:0.0:1788271611.114197:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114203:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114216:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271611.114234:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271611.114266:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b5eedb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:3279:x1875138586873856:12345-0@lo:103: Request processed in 170us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271611.114274:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271611.114300:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586873856:0@lo:103: 00010000:00010000:3.0:1788271611.114580:0:6319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271611.114589:0:6319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271611.114593:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000abf825cd/0xbeb05ca97b5f6f93 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271611.892496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271612.915925:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271613.939551:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271614.453096:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047d036e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586874112:0@lo:400: 00000100:00100000:2.0:1788271614.453178:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271614.453241:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271614.453249:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586873984:0@lo:400: 00000100:00100000:2.0:1788271614.453350:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271614.453399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586874112 00000100:00100000:2.0:1788271614.453408:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586874112 00000100:00100000:2.0:1788271614.453474:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271614.453482:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fd6e316 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586874112:12345-0@lo:400: 00000100:00100000:2.0:1788271614.453533:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fd6e316 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586874112:12345-0@lo:400: Request processed in 51us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271614.453541:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271614.453565:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586873984 00000100:00100000:2.0:1788271614.453569:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586873984 00000100:00100000:2.0:1788271614.453592:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788271614.453598:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0aa3752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:3281:x1875138586873984:12345-0@lo:400: 00000100:00100000:2.0:1788271614.453628:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0aa3752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:3281:x1875138586873984:12345-0@lo:400: Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271614.453634:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788271614.453676:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d7a4fe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586873984:0@lo:400: 00010000:00080000:2.0:1788271614.453688:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047d036e4 x1875138586874112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271614.453700:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047d036e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586874112:0@lo:400: 00010000:00010000:1.0:1788271614.965384:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271615.986684:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788271616.499492:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788271616.499516:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c9170000 from 1 10000000:01000000:2.0:1788271616.499522:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271616.499573:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000008fcf5939/0xbeb05ca97b5f6f9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271616.499587:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000008fcf5939/0xbeb05ca97b5f6f9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271616.499598:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000008fcf5939/0xbeb05ca97b5f6f9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271616.499623:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000184738de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586874240:0@lo:101: 00000100:00100000:2.0:1788271616.499710:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271616.499765:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a61422a7 going to sleep for 11 seconds 00000100:00100000:1.0:1788271616.499839:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586874240 00000100:00100000:1.0:1788271616.499847:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586874240 00000100:00100000:1.0:1788271616.499917:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788271616.499927:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e32012e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:5834:x1875138586874240:12345-0@lo:101: 00010000:00010000:1.0:1788271616.499942:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271616.499960:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6fa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6f9a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271616.499987:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271616.499998:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ba70f0a/0xbeb05ca97b5f6fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271616.500008:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ba70f0a, rc 0) 00000100:00100000:1.0:1788271616.500057:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e32012e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586874240:12345-0@lo:101: Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271616.500239:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271616.500398:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000184738de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586874240:0@lo:101: 00010000:00010000:0.0:1788271616.500508:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000008fcf5939/0xbeb05ca97b5f6f9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271616.500518:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000008fcf5939/0xbeb05ca97b5f6f9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271616.500581:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd081ad3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586874368:0@lo:501: 00000100:00100000:0.0:1788271616.500613:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271616.500679:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000009db28809 going to sleep for 11 seconds 00000100:00100000:2.0:1788271616.504532:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586874368 00000100:00100000:2.0:1788271616.504553:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586874368 00000100:00100000:2.0:1788271616.504632:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271616.504644:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082cf7da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586874368:12345-0@lo:501: 00000100:00100000:2.0:1788271616.505015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082cf7da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586874368:12345-0@lo:501: Request processed in 373us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271616.505023:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271616.505996:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd081ad3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586874368:0@lo:501: 00000100:00100000:2.0:1788271616.506050:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f5138a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586874496:0@lo:503: 00000100:00100000:2.0:1788271616.514335:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271616.514382:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000963103ac going to sleep for 11 seconds 00000100:00100000:2.0:1788271616.514409:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586874496 00000100:00100000:2.0:1788271616.514432:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586874496 00000100:00100000:2.0:1788271616.514477:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271616.514485:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a6d797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586874496:12345-0@lo:503: 00000100:00100000:2.0:1788271616.514691:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a6d797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586874496:12345-0@lo:503: Request processed in 206us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271616.514699:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271616.514759:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f5138a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586874496:0@lo:503: 00000100:00100000:2.0:1788271616.514971:0:6618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f5138a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6618:1875138586874624:0@lo:502: 00000100:00100000:2.0:1788271616.515011:0:6618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271616.515035:0:6618:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037752ad9 going to sleep for 11 seconds 00000100:00100000:1.0:1788271616.516020:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586874624 00000100:00100000:1.0:1788271616.516030:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586874624 00000100:00100000:1.0:1788271616.516081:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788271616.516091:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bca475d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6618:x1875138586874624:12345-0@lo:502: 00000100:00100000:1.0:1788271616.516297:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bca475d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6618:x1875138586874624:12345-0@lo:502: Request processed in 207us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271616.516304:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271616.517018:0:6618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f5138a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6618:1875138586874624:0@lo:502: 00000020:01000000:2.0:1788271616.517051:0:6618:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271616.517071:0:6618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271616.517073:0:6618:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788271616.517081:0:6618:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c9170000 00000020:00000080:2.0:1788271616.517083:0:6618:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788271616.517199:0:6618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6618:1875138586874752:0@lo:502: 00000100:00100000:2.0:1788271616.517256:0:6618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271616.517289:0:6618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ee089540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271616.517395:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586874752 00000100:00100000:1.0:1788271616.517400:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586874752 00000100:00100000:1.0:1788271616.517456:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788271616.517465:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6618:x1875138586874752:12345-0@lo:502: 00000100:00100000:1.0:1788271616.517612:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6618:x1875138586874752:12345-0@lo:502: Request processed in 147us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271616.517620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788271616.519567:0:6618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6618:1875138586874752:0@lo:502: 00000020:01000000:2.0:1788271616.519611:0:6618:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271616.519620:0:6618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271616.519622:0:6618:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788271616.519626:0:6618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788271616.519803:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788271616.519821:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271616.519832:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271616.519843:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271617.013322:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271618.034990:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788271618.553509:0:6695:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788271618.553514:0:6695:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788271618.553751:0:6695:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab6c914a800 00000020:01000004:1.0:1788271618.553770:0:6695:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788271618.553783:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788271618.553807:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ab6c57acd28) 00000020:00000080:1.0:1788271618.553891:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788271618.569683:0:6695:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788271618.569918:0:6695:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788271618.620326:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788271618.636130:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788271618.636165:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788271618.636228:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788271618.636270:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788271618.637633:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788271618.637645:0:6695:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788271618.637657:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbeb05ca97b5f6faf 00000020:01000004:2.0:1788271618.637666:0:6695:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788271618.637686:0:6695:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788271618.637689:0:6695:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788271618.637695:0:6695:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788271618.637699:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788271618.637713:0:6695:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ab6ffc619b8) 00000020:00000080:2.0:1788271618.637723:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788271618.640301:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271618.641083:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788271618.641101:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788271618.653465:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788271618.653478:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788271618.654501:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271618.654511:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788271618.656900:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271618.658173:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788271618.658182:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788271618.660919:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788271618.660932:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788271618.693317:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271618.694252:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788271618.694270:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788271618.702899:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788271618.702916:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788271618.705073:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788271618.705097:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788271618.715393:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271618.715796:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788271618.715803:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788271618.717945:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788271618.717958:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788271618.833941:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271618.834153:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788271618.834162:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788271618.842404:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788271618.842503:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788271618.846328:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788271618.846354:0:6695:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788271618.846361:0:6695:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788271618.887180:0:6695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788271618.887223:0:6695:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788271618.887227:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788271618.887234:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271618.887235:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271618.887236:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271618.887238:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271618.887239:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271618.887240:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271618.887242:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271618.887243:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271618.887245:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271618.887246:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271618.887250:0:6695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788271618.887252:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271618.887254:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271618.887255:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271618.887256:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271618.887257:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271618.887258:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271618.887259:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271618.887260:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271618.887261:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271618.887262:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271618.887263:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271618.887289:0:6695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788271618.887308:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586874880:0@lo:253: 00000100:00100000:2.0:1788271618.887386:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271618.890770:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c57e9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271618.892550:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586874880 00000100:00100000:1.0:1788271618.892563:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586874880 00000100:00100000:1.0:1788271618.892627:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271618.892638:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586874880:12345-0@lo:253: 20000000:01000000:1.0:1788271618.892673:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788271618.892677:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788271618.892683:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788271618.892686:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788271618.894780:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271618.895023:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788271618.895038:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788271618.895077:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788271618.895116:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788271618.895149:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788271618.895197:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788271618.896112:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788271618.896136:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:1.0:1788271618.896139:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:1.0:1788271618.896177:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788271618.896185:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788271618.896234:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788271618.896242:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:1.0:1788271618.896289:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788271618.896299:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788271618.896331:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788271618.896394:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788271618.901138:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788271618.901183:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:1.0:1788271618.901189:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:1.0:1788271618.901234:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788271618.901242:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788271618.901279:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788271618.901289:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:1.0:1788271618.901337:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788271618.901347:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788271618.901379:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788271618.902496:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788271618.902522:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788271618.902525:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788271618.902529:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788271618.902541:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788271618.902543:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788271618.902580:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788271618.902583:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788271618.904361:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788271618.904545:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788271618.904596:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788271618.910765:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788271618.910838:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788271618.910928:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788271618.910947:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788271618.910950:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788271618.912825:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788271618.912897:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788271618.912948:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788271618.913249:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788271618.913292:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788271618.913327:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788271618.913339:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788271618.913342:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788271618.919783:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788271618.920237:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788271618.920334:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788271618.920593:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788271618.920612:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788271618.920615:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788271618.920623:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788271618.920644:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920662:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f6ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920669:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c0031200/0xbeb05ca97b5f6ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920675:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f6f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920682:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920722:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f6f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920746:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f6f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 12 pid: 5831 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271618.920760:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875138586875008:0@lo:104: 00000100:00100000:0.0:1788271618.920821:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271618.920876:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c0031200/0xbeb05ca97b5f6ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920883:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c0031200/0xbeb05ca97b5f6ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 12 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271618.920892:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875138586875136:0@lo:104: 00000100:00100000:0.0:1788271618.920912:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271618.920947:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f6ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.920955:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f6ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 12 pid: 5830 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271618.920964:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875138586875264:0@lo:104: 00000100:00100000:0.0:1788271618.920986:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271618.920996:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61cc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788271618.921124:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875008 00000100:00100000:3.0:1788271618.921131:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875008 00000100:00100000:3.0:1788271618.921163:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875136 00000100:00100000:3.0:1788271618.921166:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875136 00000100:00100000:3.0:1788271618.921173:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875264 00000100:00100000:3.0:1788271618.921175:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875264 00000100:00100000:3.0:1788271618.921191:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271618.921200:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:5830:x1875138586875008:12345-0@lo:104: 00010000:00010000:3.0:1788271618.921212:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271618.921277:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271618.921283:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:5830:x1875138586875008:12345-0@lo:104: Request processed in 84us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271618.921295:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271618.921315:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788271618.921322:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:5830:x1875138586875136:12345-0@lo:104: 00010000:00010000:3.0:1788271618.921329:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271618.921361:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788271618.921367:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:5830:x1875138586875136:12345-0@lo:104: Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271618.921372:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788271618.921385:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271618.921391:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5830:x1875138586875264:12345-0@lo:104: 00010000:00010000:3.0:1788271618.921397:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921512:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271618.921518:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921525:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271618.921529:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921538:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271618.921545:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271618.921551:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271618.921585:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921592:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271618.921610:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921617:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd000/0xbeb05ca97b5f6f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f62 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921630:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271618.921633:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921639:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0030e00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271618.921642:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921649:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271618.921655:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271618.921660:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271618.921672:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921677:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271618.921682:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921697:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030e00/0xbeb05ca97b5f6eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6ef2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921707:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271618.921708:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271618.921710:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271618.921717:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271618.921734:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586875392:0@lo:103: 00000100:00100000:1.0:1788271618.921763:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271618.921788:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271618.921794:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586875520:0@lo:103: 00000100:00100000:1.0:1788271618.921812:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271618.921838:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875392 00000100:00100000:1.0:1788271618.921842:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875392 00010000:00010000:1.0:1788271618.921859:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f6f62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 13 pid: 5831 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271618.921877:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875520 00000100:00100000:1.0:1788271618.921880:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875520 00010000:00010000:1.0:1788271618.921889:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c0031200/0xbeb05ca97b5f6ef2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 14 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271618.921900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271618.921907:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:3278:x1875138586875392:12345-0@lo:103: 00010000:00010000:1.0:1788271618.921916:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271618.921922:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f6f62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 14 pid: 5831 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921942:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f6f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 14 pid: 5831 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.921958:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271618.921986:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:3278:x1875138586875392:12345-0@lo:103: Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271618.921992:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271618.922005:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271618.922011:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3278:x1875138586875520:12345-0@lo:103: 00010000:00010000:1.0:1788271618.922018:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271618.922022:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c0031200/0xbeb05ca97b5f6ef2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 13 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.922031:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c0031200/0xbeb05ca97b5f6ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 13 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.922040:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271618.922060:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3278:x1875138586875520:12345-0@lo:103: Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271618.922066:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271618.922119:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586875520:0@lo:103: 00000100:00100000:1.0:1788271618.922127:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586875392:0@lo:103: 00010000:00010000:3.0:1788271618.922217:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271618.922223:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5830:x1875138586875264:12345-0@lo:104: Request processed in 833us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271618.922231:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788271618.922277:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271618.922281:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.922287:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0030800 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271618.922296:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.922303:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271618.922309:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271618.922315:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271618.922343:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.922349:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271618.922365:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.922371:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f6ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6ed6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271618.922383:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271618.922385:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271618.922386:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271618.922396:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586875648:0@lo:103: 00010000:00010000:0.0:1788271618.923842:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f6f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f5b expref: 12 pid: 5831 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271618.923861:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875138586875008:0@lo:104: 00010000:00010000:0.0:1788271618.923873:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0031200/0xbeb05ca97b5f6ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6eeb expref: 11 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271618.923898:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875138586875136:0@lo:104: 00000100:00100000:0.0:1788271618.923910:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875138586875264:0@lo:104: 00010000:00010000:0.0:1788271618.923936:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271618.924123:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271618.924332:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875648 00000100:00100000:0.0:1788271618.924339:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875648 00010000:00010000:0.0:1788271618.924367:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f6ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 11 pid: 5830 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271618.924584:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271618.924593:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:3280:x1875138586875648:12345-0@lo:103: 00010000:00010000:0.0:1788271618.924607:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271618.924613:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f6ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 11 pid: 5830 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924625:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f6ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 11 pid: 5830 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924641:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f6ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ecf expref: 11 pid: 5830 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924655:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924663:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924678:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924694:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924700:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924707:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924712:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271618.924716:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924723:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924745:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271618.924754:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271618.924796:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:3280:x1875138586875648:12345-0@lo:103: Request processed in 204us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271618.924803:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788271618.924852:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271618.924860:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271618.924865:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f6fbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788271618.924890:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788271618.925019:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586875648:0@lo:103: 00000100:00100000:0.0:1788271619.031588:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:6695:x1875138586874880:12345-0@lo:253: Request processed in 138944us (144193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271619.031602:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271619.031699:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586874880:0@lo:253: 10000000:01000000:1.0:1788271619.031713:0:6695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788271619.031716:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788271619.031742:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271619.031744:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271619.031745:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788271619.031746:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271619.031748:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271619.031750:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271619.031751:0:6695:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788271619.031753:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271619.031754:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788271619.031769:0:6695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab6c914a800 from lustre-OST0000 10000000:01000000:1.0:1788271619.031791:0:6695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788271619.031793:0:6695:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788271619.031799:0:6695:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab6e59d0000 local copy 10000000:01000000:1.0:1788271619.031803:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788271619.031837:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.031848:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.031857:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.031873:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586875776:0@lo:101: 00000100:00100000:1.0:1788271619.031903:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.031982:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271619.036776:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875776 00000100:00100000:3.0:1788271619.036792:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875776 00000100:00100000:3.0:1788271619.036940:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788271619.036951:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:6695:x1875138586875776:12345-0@lo:101: 00010000:00010000:3.0:1788271619.036969:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271619.036991:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f6fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6fc4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.037018:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f6fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fc4 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.037029:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f6fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fc4 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.037040:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3a00, rc 0) 00000100:00100000:3.0:1788271619.037127:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:6695:x1875138586875776:12345-0@lo:101: Request processed in 178us (5223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271619.037134:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271619.037231:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586875776:0@lo:101: 00010000:00010000:1.0:1788271619.037250:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.037258:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.037441:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586875904:0@lo:501: 00000100:00100000:1.0:1788271619.037488:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.044498:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.044713:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586875904 00000100:00100000:2.0:1788271619.044722:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586875904 00000100:00100000:2.0:1788271619.044779:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788271619.044791:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:6695:x1875138586875904:12345-0@lo:501: 00000100:00100000:2.0:1788271619.047224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:6695:x1875138586875904:12345-0@lo:501: Request processed in 2426us (9727us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271619.047240:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788271619.047396:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586875904:0@lo:501: 10000000:01000000:1.0:1788271619.047526:0:6695:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788271619.047578:0:6695:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788271619.047587:0:6695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.047598:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.047607:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.047629:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788271619.047653:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab6c914a800 10000000:01000000:1.0:1788271619.047657:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788271619.047662:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ab6e59d0000 10000000:01000000:1.0:1788271619.047665:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788271619.047668:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ab6e59d0000 from 1 10000000:01000000:1.0:1788271619.047671:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788271619.047703:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.047712:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.047740:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.047760:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876032:0@lo:101: 00000100:00100000:1.0:1788271619.047799:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.047834:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271619.047914:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876032 00000100:00100000:3.0:1788271619.047921:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876032 00000100:00100000:3.0:1788271619.047961:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788271619.047970:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:6695:x1875138586876032:12345-0@lo:101: 00010000:00010000:3.0:1788271619.047982:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271619.047995:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3e00/0xbeb05ca97b5f6fd9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6fd2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.048018:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3e00/0xbeb05ca97b5f6fd9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fd2 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.048037:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3e00/0xbeb05ca97b5f6fd9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fd2 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.048045:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3e00, rc 0) 00000100:00100000:3.0:1788271619.048077:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876032:12345-0@lo:101: Request processed in 109us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271619.048092:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271619.048177:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876032:0@lo:101: 00010000:00010000:1.0:1788271619.048190:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fd9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.048199:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6fd9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271619.048215:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788271619.048231:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fd9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.048239:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fd9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271619.048245:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788271619.048249:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788271619.048253:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788271619.048255:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788271619.048269:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.048276:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.048291:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.048303:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876160:0@lo:101: 00000100:00100000:1.0:1788271619.048328:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.048346:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44780 going to sleep for 11 seconds 00010000:00010000:2.0:1788271619.048409:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271619.048514:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048527:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148b400 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271619.048532:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048540:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271619.048547:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271619.048553:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271619.048570:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048576:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271619.048595:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048602:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f6fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbeb05ca97b5f6fcb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048616:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271619.048618:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271619.048620:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271619.048627:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271619.048638:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586876288:0@lo:103: 00000100:00100000:2.0:1788271619.048668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271619.048699:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876288 00000100:00100000:2.0:1788271619.048703:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876288 00000100:00100000:2.0:1788271619.048740:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271619.048747:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:3280:x1875138586876288:12345-0@lo:103: 00010000:00010000:2.0:1788271619.048756:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271619.048767:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f6fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fc4 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048780:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271619.048806:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:3280:x1875138586876288:12345-0@lo:103: Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.048814:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271619.048840:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586876288:0@lo:103: 00000100:00100000:2.0:1788271619.048857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876160 00000100:00100000:2.0:1788271619.048861:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876160 00000100:00100000:2.0:1788271619.048875:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271619.048881:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+10:6695:x1875138586876160:12345-0@lo:101: 00010000:00010000:2.0:1788271619.048892:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271619.048905:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6fe0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048918:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048928:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.048934:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c13fca00, rc 0) 00000100:00100000:2.0:1788271619.048961:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876160:12345-0@lo:101: Request processed in 79us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.048967:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788271619.049059:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876160:0@lo:101: 00010000:00010000:1.0:1788271619.049070:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.049087:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.049170:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876416:0@lo:501: 00000100:00100000:1.0:1788271619.049196:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.049216:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.050243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876416 00000100:00100000:2.0:1788271619.050252:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876416 00000100:00100000:2.0:1788271619.050284:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271619.050292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876416:12345-0@lo:501: 00000100:00100000:2.0:1788271619.051025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876416:12345-0@lo:501: Request processed in 730us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.051034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271619.051628:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876416:0@lo:501: 00000100:00100000:1.0:1788271619.051674:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876544:0@lo:503: 00000100:00100000:1.0:1788271619.051724:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.051758:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271619.051825:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876544 00000100:00100000:3.0:1788271619.051830:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876544 00000100:00100000:3.0:1788271619.051868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788271619.051878:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876544:12345-0@lo:503: 00000100:00100000:3.0:1788271619.052090:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876544:12345-0@lo:503: Request processed in 204us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271619.052098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788271619.052809:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876544:0@lo:503: 00000040:00080000:2.0:1788271619.053097:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271619.053168:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876672:0@lo:502: 00000100:00100000:2.0:1788271619.053216:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271619.053258:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c551e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271619.053333:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876672 00000100:00100000:0.0:1788271619.053338:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876672 00000100:00100000:0.0:1788271619.053379:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788271619.053388:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876672:12345-0@lo:502: 00000100:00100000:0.0:1788271619.053635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876672:12345-0@lo:502: Request processed in 247us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271619.053642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271619.053771:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876672:0@lo:502: 00000040:00080000:2.0:1788271619.054025:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788271619.054071:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788271619.054115:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788271619.054156:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788271619.054187:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788271619.054215:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788271619.054235:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876800:0@lo:502: 00000100:00100000:2.0:1788271619.054274:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271619.054356:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c551e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271619.057620:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876800 00000100:00100000:1.0:1788271619.057639:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876800 00000100:00100000:1.0:1788271619.058523:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788271619.058537:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876800:12345-0@lo:502: 00000100:00100000:1.0:1788271619.058802:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876800:12345-0@lo:502: Request processed in 268us (4527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271619.058816:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271619.058940:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876800:0@lo:502: 00000040:00080000:2.0:1788271619.059102:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788271619.059117:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788271619.060937:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788271619.060947:0:6713:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788271619.060964:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271619.060966:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788271619.060973:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271619.060989:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ab6ffc64d28) 00000020:00000080:2.0:1788271619.061009:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788271619.061014:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271619.061074:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6c914a800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788271619.061092:0:6713:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271619.061112:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbeb05ca97b5f6ff5 00010000:00010000:0.0:1788271619.074144:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271619.074993:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788271619.075585:0:6713:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788271619.079782:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788271619.080099:0:6713:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788271619.094974:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788271619.096128:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788271619.099776:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788271619.099791:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271619.099800:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271619.099802:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788271619.099806:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271619.099810:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271619.099812:0:6713:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271619.099815:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271619.099817:0:6713:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788271619.099880:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271619.099884:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271619.099885:0:6713:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271619.099888:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788271619.100109:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788271619.100133:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788271619.100156:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.100169:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271619.100177:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c914a800 from 1 10000000:01000000:3.0:1788271619.100187:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271619.100232:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.100241:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.100252:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271619.100274:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876928:0@lo:101: 00000100:00100000:3.0:1788271619.100340:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271619.100385:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586876928 00000100:00100000:3.0:1788271619.100392:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586876928 00000100:00100000:3.0:1788271619.100476:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788271619.100486:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:6695:x1875138586876928:12345-0@lo:101: 00010000:00010000:3.0:1788271619.100499:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271619.100512:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f6ffc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.100537:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.100548:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.100557:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d2800, rc 0) 00000100:00100000:3.0:1788271619.100590:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586876928:12345-0@lo:101: Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271619.100595:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788271619.100755:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6cb558000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271619.100776:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586876928:0@lo:101: 00010000:00010000:3.0:1788271619.100789:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271619.100798:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271619.101583:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877056:0@lo:501: 00000100:00100000:3.0:1788271619.101629:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271619.101663:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.102525:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877056 00000100:00100000:2.0:1788271619.102536:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877056 00000100:00100000:2.0:1788271619.102584:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788271619.102596:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877056:12345-0@lo:501: 00000100:00100000:2.0:1788271619.102887:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877056:12345-0@lo:501: Request processed in 293us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.102895:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788271619.103259:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877056:0@lo:501: 00000100:00100000:3.0:1788271619.103310:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877184:0@lo:503: 00000100:00100000:3.0:1788271619.103357:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271619.103391:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.106088:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877184 00000100:00100000:2.0:1788271619.106107:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877184 00000100:00100000:2.0:1788271619.106164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788271619.106175:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877184:12345-0@lo:503: 00000100:00100000:2.0:1788271619.106537:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877184:12345-0@lo:503: Request processed in 363us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.106546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788271619.107138:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877184:0@lo:503: 00000040:00080000:3.0:1788271619.107650:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271619.107722:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877312:0@lo:502: 00000100:00100000:3.0:1788271619.107775:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271619.107818:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271619.108326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877312 00000100:00100000:0.0:1788271619.108333:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877312 00000100:00100000:0.0:1788271619.108377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271619.108388:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877312:12345-0@lo:502: 00000100:00100000:0.0:1788271619.108628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877312:12345-0@lo:502: Request processed in 240us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271619.108637:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788271619.108809:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877312:0@lo:502: 00000040:00080000:3.0:1788271619.109170:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788271619.109353:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788271619.109390:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877440:0@lo:502: 00000100:00100000:3.0:1788271619.111116:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271619.111721:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271619.118259:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877440 00000100:00100000:0.0:1788271619.118273:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877440 00000100:00100000:0.0:1788271619.118369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271619.118381:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877440:12345-0@lo:502: 00000100:00100000:0.0:1788271619.118678:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877440:12345-0@lo:502: Request processed in 299us (7568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271619.118687:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271619.119150:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877440:0@lo:502: 00000040:00080000:3.0:1788271619.119524:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788271619.119542:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788271619.122309:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271619.122326:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271619.122328:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788271619.122338:0:6717:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c914a800 00000020:00000080:3.0:1788271619.122341:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271619.122364:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271619.122367:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271619.122369:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788271619.122372:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788271619.123928:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788271619.124043:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271619.124110:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.124124:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271619.124585:0:6695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788271619.124589:0:6695:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab6c914a800 10000000:01000000:0.0:1788271619.124592:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab6c914a800 10000000:01000000:0.0:1788271619.124595:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271619.124601:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c914a800 from 1 10000000:01000000:0.0:1788271619.124603:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271619.124641:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271619.124650:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271619.124675:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271619.124699:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877568:0@lo:101: 00000100:00100000:0.0:1788271619.124764:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271619.124802:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.126177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877568 00000100:00100000:2.0:1788271619.126190:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877568 00000100:00100000:2.0:1788271619.126405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271619.126555:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586877568:12345-0@lo:101: 00010000:00010000:2.0:1788271619.126571:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271619.126586:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f700a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.126613:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.126624:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.126635:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c13fd000, rc 0) 00000100:00100000:2.0:1788271619.126709:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586877568:12345-0@lo:101: Request processed in 295us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.126716:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788271619.126875:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877568:0@lo:101: 00010000:00010000:0.0:1788271619.126893:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271619.126903:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271619.127184:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877696:0@lo:501: 00000100:00100000:0.0:1788271619.127570:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271619.127602:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.128061:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877696 00000100:00100000:2.0:1788271619.128067:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877696 00000100:00100000:2.0:1788271619.128160:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788271619.128169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586877696:12345-0@lo:501: 00000100:00100000:2.0:1788271619.129124:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586877696:12345-0@lo:501: Request processed in 952us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.129135:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788271619.129253:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877696:0@lo:501: 00000100:00100000:0.0:1788271619.129301:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877824:0@lo:503: 00000100:00100000:0.0:1788271619.129353:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271619.132015:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271619.135594:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877824 00000100:00100000:1.0:1788271619.135611:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877824 00000100:00100000:1.0:1788271619.135683:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788271619.135695:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586877824:12345-0@lo:503: 00000100:00100000:1.0:1788271619.136371:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586877824:12345-0@lo:503: Request processed in 674us (7014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271619.136381:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271619.138138:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877824:0@lo:503: 00000040:00080000:0.0:1788271619.138669:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788271619.138759:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877952:0@lo:502: 00000100:00100000:0.0:1788271619.138833:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271619.138869:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.139087:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586877952 00000100:00100000:2.0:1788271619.139093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586877952 00000100:00100000:2.0:1788271619.139133:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788271619.139142:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586877952:12345-0@lo:502: 00000100:00100000:2.0:1788271619.139563:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586877952:12345-0@lo:502: Request processed in 421us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.139570:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271619.140074:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586877952:0@lo:502: 00000040:00080000:0.0:1788271619.141332:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788271619.141405:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788271619.141547:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788271619.141596:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788271619.141633:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788271619.141682:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788271619.141717:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788271619.141749:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788271619.141796:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788271619.141833:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788271619.141867:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788271619.141908:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788271619.141941:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788271619.143195:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788271619.145643:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788271619.145688:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788271619.145722:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788271619.145795:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788271619.145833:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788271619.145867:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788271619.145925:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788271619.147674:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788271619.147745:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788271619.147814:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788271619.147853:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788271619.147885:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788271619.147930:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788271619.149131:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788271619.149191:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586878080:0@lo:502: 00000100:00100000:0.0:1788271619.149401:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271619.149632:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271619.152368:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878080 00000100:00100000:2.0:1788271619.152381:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878080 00000100:00100000:0.0:1788271619.155140:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788271619.155156:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586878080:12345-0@lo:502: 00000100:00100000:0.0:1788271619.156203:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586878080:12345-0@lo:502: Request processed in 1045us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271619.156215:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271619.159196:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586878080:0@lo:502: 00000040:00080000:0.0:1788271619.163066:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788271619.163101:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788271619.164292:0:6718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788271619.164308:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ab6e59d3370) 00000020:00000080:0.0:1788271619.164329:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788271619.165047:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6c914a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788271619.165053:0:6718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6c914a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788271619.165055:0:6718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c914a800 3 00010000:00080000:0.0:1788271619.165098:0:6718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6c614d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.101@tcp at head 00010000:00010000:1.0:1788271619.168779:0:6718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788271619.169114:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788271619.169160:0:6718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788271619.169175:0:6718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbeb05ca97b5f701f 00000100:00080000:1.0:1788271619.169186:0:6718:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271619.169193:0:6718:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab6c614d800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1788271619.169346:0:6718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ee3b0000 x1875138586878208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271619.169381:0:6718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788271619.171610:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586878336:0@lo:400: 00000100:00100000:0.0:1788271619.171690:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271619.171817:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875138586878208:0@lo:38: 00000100:00100000:2.0:1788271619.171853:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271619.171900:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878336 00000100:00100000:2.0:1788271619.171907:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878336 00000100:00100000:2.0:1788271619.171945:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878208 00000100:00100000:2.0:1788271619.171948:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878208 00000100:00100000:2.0:1788271619.171974:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271619.171982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586878336:12345-0@lo:400: 00000100:00100000:2.0:1788271619.172034:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586878336:12345-0@lo:400: Request processed in 52us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.172050:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271619.172069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271619.172074:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3277:x1875138586878208:12345-0@lo:38: 00010000:00080000:2.0:1788271619.172107:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1788271619.172137:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbeb05ca97b5f7026 00000004:00100000:2.0:1788271619.172151:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788271619.172179:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8ab6f757d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271619.172217:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875138586878208:12345-0@lo:38: Request processed in 141us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271619.172223:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788271619.172261:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab6ee3b0000 x1875138586878208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271619.172271:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271619.172280:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788271619.172288:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788271619.172292:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788271619.172295:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c614d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788271619.172300:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875138586878208:0@lo:38: 00010000:00080000:0.0:1788271619.172708:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab6fe9c9880 x1875138586878336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271619.172718:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586878336:0@lo:400: 00000040:00080000:1.0:1788271619.173218:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788271619.174045:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788271619.174068:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271619.174093:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271619.174105:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788271619.174156:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788271619.174158:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271619.174159:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271619.174161:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271619.174162:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271619.174163:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271619.174165:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271619.174166:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271619.174167:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271619.174169:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271619.174170:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271619.174174:0:6695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788271619.174176:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271619.174177:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271619.174178:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271619.174179:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271619.174180:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271619.174181:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271619.174182:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271619.174183:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271619.174184:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271619.174185:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271619.174186:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271619.174207:0:6695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788271619.174221:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586878464:0@lo:253: 00000100:00100000:2.0:1788271619.174281:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271619.174320:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c551ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271619.174406:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878464 00000100:00100000:1.0:1788271619.174440:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878464 00000100:00100000:1.0:1788271619.174479:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271619.174486:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6695:x1875138586878464:12345-0@lo:253: 20000000:01000000:1.0:1788271619.174508:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788271619.174520:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788271619.213574:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788271619.213595:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788271619.215073:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788271619.215090:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788271619.215112:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215142:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f6f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215150:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215187:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f6f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215200:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f6f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 13 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.215214:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875138586878592:0@lo:104: 00000100:00100000:1.0:1788271619.215279:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.215327:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271619.215355:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878592 00000100:00100000:1.0:1788271619.215361:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878592 00000100:00100000:1.0:1788271619.215405:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271619.215441:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5853:x1875138586878592:12345-0@lo:104: 00010000:00010000:1.0:1788271619.215455:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215499:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271619.215505:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5853:x1875138586878592:12345-0@lo:104: Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271619.215512:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788271619.215534:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271619.215539:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215555:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031600 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271619.215558:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215566:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271619.215573:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271619.215579:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271619.215606:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215612:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271619.215630:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215637:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f6f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6f8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215653:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271619.215655:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271619.215656:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271619.215669:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586878720:0@lo:103: 00000100:00100000:1.0:1788271619.215705:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271619.215735:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878720 00000100:00100000:1.0:1788271619.215739:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878720 00010000:00010000:1.0:1788271619.215756:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f6f8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 14 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.215784:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271619.215791:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:3279:x1875138586878720:12345-0@lo:103: 00010000:00010000:1.0:1788271619.215801:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271619.215806:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f6f8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 14 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215816:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f6f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 14 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215831:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215838:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271619.215849:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001139741s 00010000:00010000:1.0:1788271619.215853:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215859:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215865:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215869:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215874:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148ae00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271619.215877:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215891:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215900:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.215909:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271619.215937:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:3279:x1875138586878720:12345-0@lo:103: Request processed in 147us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271619.215943:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271619.216004:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586878720:0@lo:103: 00010000:00010000:1.0:1788271619.216031:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f6f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f85 expref: 13 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271619.216041:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875138586878592:0@lo:104: 00010000:00010000:1.0:1788271619.216051:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.216060:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.216066:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271619.216071:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f702d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271619.220328:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:6695:x1875138586878464:12345-0@lo:253: Request processed in 45830us (46036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271619.220344:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788271619.220567:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:6695:1875138586878464:0@lo:253: 10000000:01000000:2.0:1788271619.220584:0:6695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788271619.220587:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271619.220589:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271619.220590:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271619.220603:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271619.220605:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271619.220606:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271619.220608:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271619.220610:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271619.220611:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271619.220613:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271619.220615:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788271619.220629:0:6695:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788271619.225197:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271619.225397:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788271619.225706:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271619.225874:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788271619.226173:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271619.226390:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788271619.227830:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788271619.528579:0:6695:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788271619.528587:0:6695:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788271619.528619:0:6695:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788271619.528720:0:6695:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788271619.528735:0:6695:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788271619.528763:0:6695:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788271620.087538:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271621.108513:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271622.134957:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271623.161715:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271624.178604:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271624.178726:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586879104:0@lo:400: 00000100:00100000:2.0:1788271624.178795:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.178887:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586879104 00000100:00100000:2.0:1788271624.178894:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586879104 00000100:00100000:0.0:1788271624.178923:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586878848:0@lo:400: 00000100:00100000:2.0:1788271624.178947:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271624.178958:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586879104:12345-0@lo:400: 00000100:00100000:0.0:1788271624.178958:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271624.179004:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271624.179011:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586878976:0@lo:400: 00000100:00100000:2.0:1788271624.179022:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586879104:12345-0@lo:400: Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.179029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271624.179032:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.179046:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878976 00000100:00100000:2.0:1788271624.179050:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878976 00000100:00100000:0.0:1788271624.179054:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586878848 00000100:00100000:0.0:1788271624.179056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586878848 00000100:00100000:2.0:1788271624.179063:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271624.179068:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586878976:12345-0@lo:400: 00000100:00100000:2.0:1788271624.179101:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586878976:12345-0@lo:400: Request processed in 32us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.179107:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788271624.179131:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788271624.179158:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc167b80 x1875138586878976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271624.179172:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586878976:0@lo:400: 00010000:00080000:2.0:1788271624.179195:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc164700 x1875138586879104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271624.179204:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586879104:0@lo:400: 00000100:00100000:0.0:1788271624.179781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271624.179792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:3280:x1875138586878848:12345-0@lo:400: 00000100:00100000:0.0:1788271624.179965:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:3280:x1875138586878848:12345-0@lo:400: Request processed in 174us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271624.179974:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271624.180035:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586878848:0@lo:400: 10000000:01000000:1.0:1788271624.691403:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788271624.691436:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c9170000 from 21 10000000:01000000:1.0:1788271624.691441:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788271624.691499:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.691511:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.691523:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271624.691547:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879232:0@lo:101: 00000100:00100000:1.0:1788271624.691616:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271624.691671:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271624.694314:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586879232 00000100:00100000:3.0:1788271624.694332:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586879232 00000100:00100000:3.0:1788271624.694441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788271624.694453:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586879232:12345-0@lo:101: 00010000:00010000:3.0:1788271624.694469:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271624.694497:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7034 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.694527:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.694557:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.694566:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3000, rc 0) 00000100:00100000:3.0:1788271624.694647:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586879232:12345-0@lo:101: Request processed in 196us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271624.694653:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271624.694836:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879232:0@lo:101: 00010000:00010000:1.0:1788271624.694854:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.694864:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271624.694926:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879360:0@lo:501: 00000100:00100000:1.0:1788271624.694957:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271624.695000:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271624.695151:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586879360 00000100:00100000:3.0:1788271624.695156:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586879360 00000100:00100000:3.0:1788271624.695187:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788271624.695194:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586879360:12345-0@lo:501: 00000100:00100000:3.0:1788271624.695588:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586879360:12345-0@lo:501: Request processed in 394us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271624.695595:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788271624.695903:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879360:0@lo:501: 00000100:00100000:1.0:1788271624.695932:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879488:0@lo:503: 00000100:00100000:1.0:1788271624.695992:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271624.696021:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271624.696184:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586879488 00000100:00100000:3.0:1788271624.696188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586879488 00000100:00100000:3.0:1788271624.696222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788271624.696230:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586879488:12345-0@lo:503: 00000100:00100000:3.0:1788271624.697027:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586879488:12345-0@lo:503: Request processed in 794us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271624.697036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788271624.702933:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879488:0@lo:503: 00000100:00100000:3.0:1788271624.706346:0:6996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6996:1875138586879616:0@lo:502: 00000100:00100000:3.0:1788271624.706445:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271624.706496:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586879616 00000100:00100000:3.0:1788271624.706503:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586879616 00000100:00100000:3.0:1788271624.706545:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788271624.706560:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6996:x1875138586879616:12345-0@lo:502: 00000100:00100000:3.0:1788271624.706970:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6996:x1875138586879616:12345-0@lo:502: Request processed in 409us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271624.706989:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788271624.707046:0:6996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271624.707135:0:6996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6996:1875138586879616:0@lo:502: 00000100:00100000:3.0:1788271624.707182:0:6996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6996:1875138586879744:0@lo:502: 00000100:00100000:3.0:1788271624.707215:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271624.707235:0:6996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7002170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271624.709881:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586879744 00000100:00100000:2.0:1788271624.709898:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586879744 00000100:00100000:2.0:1788271624.709959:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788271624.709971:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6996:x1875138586879744:12345-0@lo:502: 00000100:00100000:2.0:1788271624.710972:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:6996:x1875138586879744:12345-0@lo:502: Request processed in 998us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.710992:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788271624.711258:0:6996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6996:1875138586879744:0@lo:502: 00000040:00080000:3.0:1788271624.711296:0:6996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788271624.711370:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788271624.711388:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271624.711398:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.711431:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271624.711443:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788271624.711446:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6c9170000 from 4 10000000:01000000:3.0:1788271624.711449:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788271624.712163:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.712173:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.712197:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271624.712216:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879872:0@lo:101: 00000100:00100000:3.0:1788271624.712849:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271624.712893:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7002170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271624.714383:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586879872 00000100:00100000:2.0:1788271624.714396:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586879872 00000100:00100000:2.0:1788271624.714457:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788271624.714465:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586879872:12345-0@lo:101: 00010000:00010000:2.0:1788271624.714490:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271624.714507:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7042 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.714530:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.714539:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.714565:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c13fc000, rc 0) 00000100:00100000:2.0:1788271624.714627:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586879872:12345-0@lo:101: Request processed in 162us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.714633:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788271624.714700:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586879872:0@lo:101: 00010000:00010000:2.0:1788271624.714717:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.714725:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271624.714781:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880000:0@lo:256: 00000100:00100000:2.0:1788271624.714813:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.715333:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271624.715354:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880000 00000100:00100000:2.0:1788271624.715358:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880000 00000100:00100000:2.0:1788271624.715386:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271624.715393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586880000:12345-0@lo:256: 20000000:01000000:2.0:1788271624.715408:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788271624.715444:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788271624.715447:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788271624.715536:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586880000:12345-0@lo:256: Request processed in 143us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.715544:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271624.715578:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880000:0@lo:256: 10000000:01000000:2.0:1788271624.715615:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788271624.715626:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.715651:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271624.715662:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788271624.715664:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788271624.715667:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788271624.715685:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.715694:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.715702:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271624.715715:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880128:0@lo:101: 00000100:00100000:2.0:1788271624.715741:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.715754:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271624.715765:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880128 00000100:00100000:2.0:1788271624.715769:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880128 00000100:00100000:2.0:1788271624.715788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271624.715794:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586880128:12345-0@lo:101: 00010000:00010000:2.0:1788271624.715801:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271624.716618:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7050 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.716657:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.716675:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.716683:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024aa00, rc 0) 00000100:00100000:2.0:1788271624.716723:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586880128:12345-0@lo:101: Request processed in 928us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.716729:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271624.716770:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880128:0@lo:101: 00010000:00010000:2.0:1788271624.716782:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271624.716790:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271624.717152:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880256:0@lo:501: 00000100:00100000:2.0:1788271624.717184:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.717211:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271624.717225:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880256 00000100:00100000:2.0:1788271624.717230:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880256 00000100:00100000:2.0:1788271624.717738:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271624.717748:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586880256:12345-0@lo:501: 00000100:00100000:2.0:1788271624.718215:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586880256:12345-0@lo:501: Request processed in 467us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.718223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271624.719192:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880256:0@lo:501: 00000100:00100000:2.0:1788271624.719876:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880384:0@lo:503: 00000100:00100000:2.0:1788271624.719946:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.720041:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271624.727938:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880384 00000100:00100000:1.0:1788271624.727954:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880384 00000100:00100000:1.0:1788271624.728083:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788271624.728095:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586880384:12345-0@lo:503: 00000100:00100000:1.0:1788271624.728552:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586880384:12345-0@lo:503: Request processed in 458us (8604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271624.728560:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788271624.728629:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586880384:0@lo:503: 00000100:00100000:1.0:1788271624.732069:0:6997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6997:1875138586880512:0@lo:502: 00000100:00100000:1.0:1788271624.732161:0:6997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271624.732205:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880512 00000100:00100000:1.0:1788271624.732212:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880512 00000100:00100000:1.0:1788271624.732253:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788271624.732262:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:6997:x1875138586880512:12345-0@lo:502: 00000100:00100000:1.0:1788271624.733231:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:6997:x1875138586880512:12345-0@lo:502: Request processed in 964us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271624.733243:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788271624.733299:0:6997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271624.733320:0:6997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6997:1875138586880512:0@lo:502: 00000020:01000000:1.0:1788271624.734133:0:6997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271624.734141:0:6997:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788271624.734148:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271624.734161:0:6997:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788271624.734168:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788271624.734172:0:6997:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:1.0:1788271624.734195:0:6997:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788271624.734198:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271624.734214:0:6997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ab6c57a8000) 00000020:00000080:1.0:1788271624.734234:0:6997:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788271624.734240:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788271624.734322:0:6997:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788271624.736558:0:6997:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788271624.736592:0:6997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f7065 00010000:00080000:1.0:1788271624.736629:0:6997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6ca68d800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:1.0:1788271624.737211:0:6997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788271624.849551:0:6997:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788271624.849574:0:6997:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788271624.851129:0:6997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271624.851309:0:6997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271624.851357:0:6997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788271624.851433:0:6997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788271624.852651:0:7001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271624.852658:0:7001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788271624.854033:0:6997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788271624.854048:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788271624.854084:0:6997:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788271624.854107:0:6997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f706c 00000100:00080000:2.0:1788271624.854117:0:6997:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271624.854123:0:6997:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab6ca68d800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271624.854161:0:6997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6cc167b80 x1875138586880640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271624.854192:0:6997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788271624.854256:0:6997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271624.854261:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271624.854263:0:6997:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788271624.854267:0:6997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271624.854271:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271624.854273:0:6997:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271624.854276:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271624.854278:0:6997:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788271624.854308:0:6997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6997:1875138586880768:0@lo:502: 00000100:00100000:2.0:1788271624.854396:0:6997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.854477:0:6997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61850c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271624.854499:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586880640:0@lo:8: 00000100:00100000:2.0:1788271624.854531:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.854629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880768 00000100:00100000:2.0:1788271624.854636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880768 00000100:00100000:2.0:1788271624.854673:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788271624.854690:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:6997:x1875138586880768:12345-0@lo:502: 00000100:00100000:2.0:1788271624.854928:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:6997:x1875138586880768:12345-0@lo:502: Request processed in 238us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.854935:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788271624.854997:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880640 00000100:00100000:2.0:1788271624.855001:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880640 00000100:00100000:2.0:1788271624.855022:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271624.855027:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875138586880640:12345-0@lo:8: 00010000:00080000:2.0:1788271624.855048:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1788271624.855071:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f7073 00002000:00100000:2.0:1788271624.855104:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ab6fe9ba000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788271624.855108:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788271624.855111:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788271624.855221:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788271624.855391:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788271624.855445:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ab6fe9b8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271624.855497:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875138586880640:12345-0@lo:8: Request processed in 467us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.855504:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271624.855533:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586880896:0@lo:400: 00000100:00100000:2.0:1788271624.855565:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.855624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586880896 00000100:00100000:2.0:1788271624.855629:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586880896 00000100:00100000:2.0:1788271624.855657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271624.855665:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586880896:12345-0@lo:400: 00000100:00100000:2.0:1788271624.855702:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586880896:12345-0@lo:400: Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.855715:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788271624.855759:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc167b80 x1875138586880640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271624.855771:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271624.855780:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788271624.855789:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788271624.855795:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788271624.855798:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca68d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788271624.855809:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788271624.855816:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586880640:0@lo:8: 00010000:00080000:2.0:1788271624.855846:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc167480 x1875138586880896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271624.855855:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586880896:0@lo:400: 00000100:00100000:2.0:1788271624.855879:0:6997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:6997:1875138586880768:0@lo:502: 00000020:01000000:2.0:1788271624.855911:0:6997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271624.855918:0:6997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271624.855920:0:6997:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271624.855925:0:6997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788271624.857190:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586881024:0@lo:400: 00000100:00100000:1.0:1788271624.857249:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788271624.857299:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788271624.857321:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788271624.857331:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.857342:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271624.857351:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788271624.857354:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab6e59d0000 from 1 10000000:01000000:1.0:1788271624.857363:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788271624.857394:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.857403:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.857428:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271624.857443:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586881152:0@lo:101: 00000100:00100000:1.0:1788271624.857484:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271624.857517:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271624.857728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881024 00000100:00100000:0.0:1788271624.857736:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881024 00000100:00100000:3.0:1788271624.857763:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881152 00000100:00100000:3.0:1788271624.857770:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881152 00000100:00100000:0.0:1788271624.857789:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271624.857800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586881024:12345-0@lo:400: 00000100:00100000:3.0:1788271624.857811:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788271624.857822:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586881152:12345-0@lo:101: 00010000:00010000:3.0:1788271624.857832:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271624.857844:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f707a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.857867:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.857878:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271624.857888:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3600, rc 0) 00000100:00100000:3.0:1788271624.857929:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586881152:12345-0@lo:101: Request processed in 110us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271624.857936:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788271624.857963:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586881024:12345-0@lo:400: Request processed in 164us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271624.857971:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788271624.858026:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc165f80 x1875138586881024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271624.858039:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586881024:0@lo:400: 00000100:00100000:1.0:1788271624.858162:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586881152:0@lo:101: 00010000:00010000:1.0:1788271624.858178:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.858187:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271624.858233:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586881280:0@lo:501: 00000100:00100000:1.0:1788271624.858260:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271624.858282:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271624.858296:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881280 00000100:00100000:1.0:1788271624.858299:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881280 00000100:00100000:1.0:1788271624.858330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271624.858337:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586881280:12345-0@lo:501: 00000100:00100000:1.0:1788271624.859144:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586881280:12345-0@lo:501: Request processed in 805us (881us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271624.859162:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271624.859206:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586881280:0@lo:501: 10000000:01000000:1.0:1788271624.859234:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788271624.859242:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271624.859251:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271624.859359:0:7001:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788271624.862595:0:7001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 188044178523ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788271624.904839:0:7002:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788271624.904872:0:7002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586881536:0@lo:7: 00000100:00100000:0.0:1788271624.904943:0:7002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271624.905011:0:7002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271624.905028:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271624.905054:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586881408:0@lo:13: 00000100:00100000:0.0:1788271624.905081:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.905263:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881536 00000100:00100000:2.0:1788271624.905271:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881536 00000100:00100000:2.0:1788271624.905444:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271624.905801:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7002:x1875138586881536:12345-0@lo:7: 00000100:00100000:3.0:1788271624.907529:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881408 00000100:00100000:3.0:1788271624.907540:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881408 00000100:00100000:3.0:1788271624.907579:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271624.907594:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875138586881408:12345-0@lo:13: 00002000:00000024:3.0:1788271624.907621:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788271624.907690:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875138586881408:12345-0@lo:13: Request processed in 97us (2608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271624.907698:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788271624.907744:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6fe9c9500 x1875138586881408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271624.907763:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586881408:0@lo:13: 00000100:00080000:1.0:1788271624.911306:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788271624.915227:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788271624.915235:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788271624.915491:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7002:x1875138586881536:12345-0@lo:7: Request processed in 10034us (10543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271624.915510:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788271624.916588:0:7002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6fe9c8380 x1875138586881536/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788271640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271624.916605:0:7002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586881536:0@lo:7: 00000004:00080000:0.0:1788271624.916621:0:7002:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788271624.916656:0:7002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586881664:0@lo:5: 00000100:00100000:0.0:1788271624.916700:0:7002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271624.916784:0:7002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271624.917404:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881664 00000100:00100000:2.0:1788271624.918131:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881664 00000100:00100000:2.0:1788271624.918517:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271624.918529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7002:x1875138586881664:12345-0@lo:5: 00002000:00080000:2.0:1788271624.918563:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788271624.918567:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788271624.918925:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7002:x1875138586881664:12345-0@lo:5: Request processed in 398us (2223us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788271624.918934:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788271624.919457:0:7002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6fe9c8380 x1875138586881664/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271624.919476:0:7002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586881664:0@lo:5: 00000004:00080000:2.0:1788271624.919491:0:7002:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788271624.919527:0:7002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586881792:0@lo:700: 00000100:00100000:2.0:1788271624.919563:0:7002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271624.919599:0:7002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271624.919683:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881792 00000100:00100000:0.0:1788271624.919689:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881792 00000100:00100000:0.0:1788271624.919724:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271624.919732:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7002:x1875138586881792:12345-0@lo:700: 00000100:00100000:0.0:1788271624.919765:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1875138586881920:0@lo:700: 00000100:00100000:0.0:1788271624.919796:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271624.919822:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271624.919898:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586881920 00000100:00100000:1.0:1788271624.919904:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586881920 00000100:00100000:1.0:1788271624.919944:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271624.919951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1875138586881920:12345-0@lo:700: 00000004:00080000:1.0:1788271624.954280:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788271625.000542:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788271625.005188:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1875138586881920:12345-0@lo:700: Request processed in 85229us (85382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271625.005207:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788271625.005340:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6fe9cb800 x1875138586881920/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788271640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271625.005358:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1875138586881920:0@lo:700: 40000000:02000000:0.0:1788271625.005376:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788271625.084163:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788271625.084183:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788271625.084338:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7002:x1875138586881792:12345-0@lo:700: Request processed in 164602us (164768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271625.084377:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788271625.084600:0:7002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc165c00 x1875138586881792/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788271640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271625.084629:0:7002:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788271625.084647:0:7002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586881792:0@lo:700: 00000004:02000040:2.0:1788271625.176432:0:7002:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788271625.182503:0:7002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586882048:0@lo:5: 00000100:00100000:2.0:1788271625.182587:0:7002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271625.182638:0:7002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271625.182662:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882048 00000100:00100000:2.0:1788271625.182668:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882048 00000100:00100000:2.0:1788271625.182725:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271625.182734:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7002:x1875138586882048:12345-0@lo:5: 00002000:00080000:2.0:1788271625.194133:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788271625.194156:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788271625.201253:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7002:x1875138586882048:12345-0@lo:5: Request processed in 18509us (18655us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788271625.201267:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788271625.203403:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788271625.205032:0:7002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc165c00 x1875138586882048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271641 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271625.205058:0:7002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7002:1875138586882048:0@lo:5: 00000004:00080000:0.0:1788271625.205074:0:7002:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:3.0:1788271625.877907:0:7067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788271626.228888:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271627.250678:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271628.274539:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271629.304894:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271630.323273:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271630.325567:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586882176:0@lo:13: 00000100:00100000:3.0:1788271630.325637:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271630.325746:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882176 00000100:00100000:3.0:1788271630.325753:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882176 00000100:00100000:3.0:1788271630.325805:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271630.325814:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586882176:12345-0@lo:13: 00002000:00000024:3.0:1788271630.325847:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271630.325904:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586882176:12345-0@lo:13: Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271630.325912:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788271630.325933:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271630.325962:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ee3b2a00 x1875138586882176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271630.325980:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586882176:0@lo:13: 00000100:00100000:0.0:1788271630.326624:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586882432:0@lo:400: 00000100:00100000:0.0:1788271630.326666:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271630.326695:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271630.326703:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586882560:0@lo:400: 00000100:00100000:0.0:1788271630.326727:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271630.326757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882432 00000100:00100000:0.0:1788271630.326762:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882432 00000100:00100000:0.0:1788271630.326793:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882560 00000100:00100000:0.0:1788271630.326796:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882560 00000100:00100000:0.0:1788271630.326818:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271630.326827:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586882432:12345-0@lo:400: 00000100:00100000:0.0:1788271630.326870:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586882432:12345-0@lo:400: Request processed in 44us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271630.326876:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271630.326909:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271630.326917:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586882560:12345-0@lo:400: 00000100:00100000:0.0:1788271630.326947:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586882560:12345-0@lo:400: Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271630.326954:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788271630.326975:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788271630.327190:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6fe9c8a80 x1875138586882560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271630.327203:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586882560:0@lo:400: 00010000:00080000:0.0:1788271630.327214:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6fe9c9180 x1875138586882432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271630.327238:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586882432:0@lo:400: 00000100:00100000:0.0:1788271630.327263:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271630.327271:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586882304:0@lo:400: 00000100:00100000:0.0:1788271630.327309:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271630.327350:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882304 00000100:00100000:0.0:1788271630.327355:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882304 00000100:00100000:0.0:1788271630.327385:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788271630.327393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3278:x1875138586882304:12345-0@lo:400: 00000100:00100000:0.0:1788271630.329241:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3278:x1875138586882304:12345-0@lo:400: Request processed in 1841us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271630.329255:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788271630.354452:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586882304:0@lo:400: 00000001:00080000:2.0:1788271630.405080:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788271631.349373:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271632.371776:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271633.402064:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271634.418626:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271635.442778:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271635.443005:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586882944:0@lo:400: 00000100:00100000:2.0:1788271635.443076:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271635.443229:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586882816:0@lo:400: 00000100:00100000:1.0:1788271635.443262:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271635.443286:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271635.443291:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586882688:0@lo:400: 00000100:00100000:1.0:1788271635.443319:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271635.443366:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882944 00000100:00100000:1.0:1788271635.443373:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882944 00000100:00100000:1.0:1788271635.443454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882816 00000100:00100000:1.0:1788271635.443457:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882816 00000100:00100000:1.0:1788271635.443490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271635.443499:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586882944:12345-0@lo:400: 00000100:00100000:1.0:1788271635.443545:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586882944:12345-0@lo:400: Request processed in 47us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271635.443553:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271635.443568:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788271635.443575:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586882816:12345-0@lo:400: 00000100:00100000:1.0:1788271635.443605:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586882816:12345-0@lo:400: Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271635.443611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788271635.443626:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788271635.443653:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc164000 x1875138586882816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271635.443668:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586882816:0@lo:400: 00010000:00080000:2.0:1788271635.443836:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc167800 x1875138586882944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271635.443847:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586882944:0@lo:400: 00000100:00100000:2.0:1788271635.443857:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271635.443871:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586883072:0@lo:400: 00000100:00100000:2.0:1788271635.443899:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271635.443946:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586882688 00000100:00100000:2.0:1788271635.443951:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586882688 00000100:00100000:2.0:1788271635.443980:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788271635.443987:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3279:x1875138586882688:12345-0@lo:400: 00000100:00100000:2.0:1788271635.444024:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3279:x1875138586882688:12345-0@lo:400: Request processed in 38us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271635.444030:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788271635.444068:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586882688:0@lo:400: 00000100:00100000:1.0:1788271635.445471:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883072 00000100:00100000:1.0:1788271635.445483:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883072 00000100:00100000:1.0:1788271635.445539:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271635.445550:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586883072:12345-0@lo:400: 00000100:00100000:1.0:1788271635.445620:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586883072:12345-0@lo:400: Request processed in 73us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271635.445628:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788271635.446565:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788271635.446604:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc165f80 x1875138586883072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271635.446617:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788271635.446635:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586883072:0@lo:400: 00000100:00100000:1.0:1788271635.451505:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586883200:0@lo:13: 00000100:00100000:1.0:1788271635.451565:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271635.451618:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883200 00000100:00100000:1.0:1788271635.451624:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883200 00000100:00100000:1.0:1788271635.451660:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271635.451665:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586883200:12345-0@lo:13: 00002000:00000024:1.0:1788271635.451699:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271635.451731:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586883200:12345-0@lo:13: Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271635.451735:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788271635.451774:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ee3b1500 x1875138586883200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271635.451787:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586883200:0@lo:13: 00010000:00010000:1.0:1788271636.469206:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271637.492987:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788271637.532270:0:7624:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788271637.532274:0:7624:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788271637.532408:0:7624:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab6ee935800 00000020:01000004:2.0:1788271637.532447:0:7624:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788271637.532460:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788271637.532482:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ab6c9f08000) 00000020:00000080:2.0:1788271637.532498:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788271637.559891:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788271637.560496:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788271637.607662:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788271637.616288:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788271637.616691:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788271637.617230:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788271637.617461:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788271637.618586:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788271637.618605:0:7624:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788271637.618617:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbeb05ca97b5f708f 00000020:01000004:2.0:1788271637.618625:0:7624:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788271637.618646:0:7624:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788271637.618650:0:7624:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788271637.618656:0:7624:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788271637.618680:0:7624:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788271637.618685:0:7624:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788271637.658629:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788271637.658666:0:7624:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.101@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788271637.658670:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788271637.658671:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271637.658673:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271637.658674:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271637.658675:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271637.658677:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271637.658678:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271637.658680:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271637.658681:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271637.658683:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271637.658684:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271637.658687:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788271637.658690:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271637.658691:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271637.658692:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271637.658693:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271637.658694:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271637.658695:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271637.658696:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271637.658697:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271637.658698:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271637.658699:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271637.658700:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271637.658732:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788271637.658750:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586883328:0@lo:253: 00000100:00100000:2.0:1788271637.658832:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.659358:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883328 00000100:00100000:3.0:1788271637.659367:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883328 00000100:00100000:3.0:1788271637.659463:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271637.659472:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:7624:x1875138586883328:12345-0@lo:253: 20000000:01000000:3.0:1788271637.659502:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788271637.659506:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788271637.659512:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788271637.659516:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788271637.660695:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271637.661179:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788271637.661195:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788271637.661252:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788271637.661261:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788271637.661289:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788271637.661345:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788271637.662894:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788271637.662922:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:3.0:1788271637.662924:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788271637.662965:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788271637.662973:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788271637.663020:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788271637.663027:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:3.0:1788271637.663057:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788271637.663066:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000100:00100000:2.0:1788271637.663511:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad600 going to sleep for 11 seconds 00000040:00080000:3.0:1788271637.663851:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788271637.663937:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788271637.670882:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788271637.670928:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:3.0:1788271637.670931:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788271637.671668:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788271637.671680:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788271637.671718:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788271637.671725:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:3.0:1788271637.671792:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788271637.671802:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788271637.671870:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788271637.671929:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788271637.671965:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788271637.671968:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788271637.671974:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788271637.671976:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788271637.671978:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788271637.671992:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788271637.671994:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788271637.672036:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788271637.672038:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788271637.681861:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788271637.681967:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788271637.682026:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788271637.682448:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788271637.682495:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788271637.682558:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788271637.682570:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788271637.682573:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788271637.683571:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788271637.683835:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788271637.683876:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788271637.683959:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788271637.683976:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788271637.683978:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788271637.684751:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788271637.684819:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788271637.684864:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788271637.685167:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788271637.685201:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788271637.685228:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788271637.685239:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788271637.685241:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788271637.686472:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788271637.686559:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788271637.686611:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788271637.686930:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788271637.686985:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788271637.687041:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1788271637.687058:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788271637.687078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687094:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687202:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687209:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687216:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687222:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687230:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687386:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687401:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 16 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271637.687498:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883456:0@lo:104: 00000100:00100000:3.0:1788271637.687563:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271637.687609:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687616:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 16 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271637.687623:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883584:0@lo:104: 00010000:00010000:3.0:1788271637.687654:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687661:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 16 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271637.687669:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883712:0@lo:104: 00010000:00010000:3.0:1788271637.687686:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687694:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 16 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271637.687700:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883840:0@lo:104: 00010000:00010000:3.0:1788271637.687720:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.687727:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 16 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271637.687733:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883968:0@lo:104: 00000100:00100000:3.0:1788271637.687747:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4e8c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271637.688010:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788271637.688032:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.688062:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.688070:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.688079:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.688091:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883456 00000100:00100000:1.0:1788271637.688168:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883456 00000100:00100000:1.0:1788271637.688203:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883584 00000100:00100000:1.0:1788271637.688206:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883584 00000100:00100000:1.0:1788271637.688228:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883712 00000100:00100000:1.0:1788271637.688231:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883712 00000100:00100000:1.0:1788271637.688240:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883840 00000100:00100000:1.0:1788271637.688242:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883840 00000100:00100000:1.0:1788271637.688384:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586883968 00000100:00100000:1.0:1788271637.688388:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586883968 00000100:00100000:1.0:1788271637.688404:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271637.688634:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa13050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+7:5832:x1875138586883456:12345-0@lo:104: 00010000:00010000:1.0:1788271637.688649:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.688774:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271637.688780:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa13050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+7:5832:x1875138586883456:12345-0@lo:104: Request processed in 368us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.688787:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271637.688830:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271637.688837:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:5832:x1875138586883584:12345-0@lo:104: 00010000:00010000:1.0:1788271637.688845:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.688878:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271637.688882:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:5832:x1875138586883584:12345-0@lo:104: Request processed in 47us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.688888:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271637.688899:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271637.688904:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:5832:x1875138586883712:12345-0@lo:104: 00010000:00010000:1.0:1788271637.688911:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.688947:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788271637.688953:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:5832:x1875138586883712:12345-0@lo:104: Request processed in 48us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.688959:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271637.688968:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271637.688973:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:5832:x1875138586883840:12345-0@lo:104: 00010000:00010000:1.0:1788271637.688980:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.689001:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788271637.689004:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:5832:x1875138586883840:12345-0@lo:104: Request processed in 32us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.689009:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271637.689019:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788271637.689024:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5832:x1875138586883968:12345-0@lo:104: 00010000:00010000:1.0:1788271637.689030:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.689050:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788271637.689054:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5832:x1875138586883968:12345-0@lo:104: Request processed in 31us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.689059:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788271637.689229:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788271637.689236:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689244:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148b400 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271637.689263:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689272:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271637.689280:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271637.689286:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271637.689336:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689343:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271637.689363:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689370:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148b400/0xbeb05ca97b5f707a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7081 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689385:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788271637.689388:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689394:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd600 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271637.689396:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689402:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271637.689445:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271637.689450:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271637.689463:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689468:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271637.689482:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689488:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd600/0xbeb05ca97b5f7050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7057 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689498:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788271637.689501:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689505:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148ae00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271637.689508:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689513:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271637.689518:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271637.689523:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271637.689542:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689547:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271637.689552:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689558:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ae00/0xbeb05ca97b5f7034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f703b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689566:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271637.689569:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689575:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031200 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271637.689578:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689583:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271637.689589:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271637.689594:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271637.689604:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689609:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271637.689613:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689628:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f700a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7011 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689637:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271637.689640:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689645:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148a800 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271637.689649:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689655:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271637.689661:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271637.689665:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271637.689676:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689681:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271637.689684:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689690:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f6fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6fe7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.689701:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271637.689706:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271637.689708:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271637.689714:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271637.689728:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586884096:0@lo:103: 00000100:00100000:0.0:1788271637.689779:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.689815:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586884608:0@lo:103: 00000100:00100000:0.0:1788271637.689835:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.689856:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271637.689861:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586884480:0@lo:103: 00000100:00100000:0.0:1788271637.689897:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.689925:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586884224:0@lo:103: 00000100:00100000:0.0:1788271637.689945:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.689969:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271637.689973:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586884352:0@lo:103: 00000100:00100000:0.0:1788271637.689991:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.690014:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884096 00000100:00100000:0.0:1788271637.690018:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884096 00010000:00010000:0.0:1788271637.690038:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 17 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.690053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884608 00000100:00100000:0.0:1788271637.690055:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884608 00010000:00010000:0.0:1788271637.690064:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 18 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.690072:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884480 00000100:00100000:0.0:1788271637.690074:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884480 00010000:00010000:0.0:1788271637.690083:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 19 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.690569:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884224 00000100:00100000:0.0:1788271637.690573:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884224 00010000:00010000:0.0:1788271637.690587:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 20 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.690596:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884352 00000100:00100000:0.0:1788271637.690598:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884352 00010000:00010000:0.0:1788271637.690605:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 21 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.690615:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271637.690621:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+21:3279:x1875138586884096:12345-0@lo:103: 00010000:00010000:0.0:1788271637.690631:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271637.690636:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 21 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690646:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 21 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690661:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271637.690693:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+21:3279:x1875138586884096:12345-0@lo:103: Request processed in 71us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.690699:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271637.690712:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271637.690718:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3279:x1875138586884608:12345-0@lo:103: 00010000:00010000:0.0:1788271637.690724:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271637.690728:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 20 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690744:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 20 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690764:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271637.690785:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3279:x1875138586884608:12345-0@lo:103: Request processed in 68us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.690791:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271637.690804:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271637.690810:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586884480:12345-0@lo:103: 00010000:00010000:0.0:1788271637.690816:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271637.690820:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 19 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690829:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 19 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690838:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271637.690858:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586884480:12345-0@lo:103: Request processed in 48us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.690863:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271637.690873:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271637.690878:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:3280:x1875138586884224:12345-0@lo:103: 00010000:00010000:0.0:1788271637.690884:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271637.690888:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 18 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690895:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 18 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.690908:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271637.690930:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:3280:x1875138586884224:12345-0@lo:103: Request processed in 52us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.690935:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271637.691222:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271637.691230:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3280:x1875138586884352:12345-0@lo:103: 00010000:00010000:0.0:1788271637.691237:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271637.691242:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 17 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692194:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 17 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692210:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692217:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692232:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692239:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692303:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692312:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692329:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d2200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271637.692333:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692341:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692350:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.692360:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271637.692402:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3280:x1875138586884352:12345-0@lo:103: Request processed in 1172us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.692409:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271637.692480:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586884352:0@lo:103: 00000100:00100000:0.0:1788271637.692491:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586884224:0@lo:103: 00000100:00100000:0.0:1788271637.692524:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586884480:0@lo:103: 00000100:00100000:0.0:1788271637.692533:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586884096:0@lo:103: 00000100:00100000:0.0:1788271637.692540:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586884608:0@lo:103: 00010000:00010000:2.0:1788271637.693612:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f707a expref: 16 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.693630:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883456:0@lo:104: 00010000:00010000:2.0:1788271637.693642:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024aa00/0xbeb05ca97b5f7057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f7050 expref: 15 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.693651:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883584:0@lo:104: 00010000:00010000:2.0:1788271637.693660:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3000/0xbeb05ca97b5f703b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f7034 expref: 14 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.693667:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883712:0@lo:104: 00010000:00010000:2.0:1788271637.693675:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c13fd000/0xbeb05ca97b5f7011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f700a expref: 13 pid: 5832 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.693688:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883840:0@lo:104: 00010000:00010000:2.0:1788271637.693697:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c13fca00/0xbeb05ca97b5f6fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6fe0 expref: 12 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.693707:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875138586883968:0@lo:104: 00010000:00010000:2.0:1788271637.693731:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.693741:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.693747:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.693778:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7096 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788271637.693795:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788271637.746539:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:7624:x1875138586883328:12345-0@lo:253: Request processed in 87058us (87696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271637.746556:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788271637.746646:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586883328:0@lo:253: 10000000:01000000:0.0:1788271637.746662:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788271637.746666:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788271637.746667:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788271637.746669:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271637.746670:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788271637.746685:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271637.746687:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271637.746689:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271637.746690:0:7624:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788271637.746692:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271637.746693:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788271637.746715:0:7624:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab6ee935800 from lustre-OST0001 10000000:01000000:0.0:1788271637.746738:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788271637.746741:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788271637.746749:0:7624:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab6e59d0000 local copy 10000000:01000000:0.0:1788271637.746888:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788271637.746928:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.746939:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.746949:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.746966:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586884736:0@lo:101: 00000100:00100000:0.0:1788271637.747001:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.747176:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271637.747355:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884736 00000100:00100000:2.0:1788271637.747362:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884736 00000100:00100000:1.0:1788271637.747579:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788271637.747592:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:7624:x1875138586884736:12345-0@lo:101: 00010000:00010000:1.0:1788271637.747604:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271637.747625:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c148a800/0xbeb05ca97b5f70a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f709d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.747649:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c148a800/0xbeb05ca97b5f70a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f709d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.747660:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c148a800/0xbeb05ca97b5f70a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f709d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.747669:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148a800, rc 0) 00000100:00100000:1.0:1788271637.747720:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586884736:12345-0@lo:101: Request processed in 132us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.747727:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788271637.747810:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586884736:0@lo:101: 00010000:00010000:2.0:1788271637.747823:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.747831:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.747932:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586884864:0@lo:501: 00000100:00100000:2.0:1788271637.747959:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271637.748061:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271637.748204:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884864 00000100:00100000:0.0:1788271637.748209:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884864 00000100:00100000:0.0:1788271637.748230:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788271637.748237:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586884864:12345-0@lo:501: 00000100:00100000:0.0:1788271637.748599:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586884864:12345-0@lo:501: Request processed in 361us (637us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271637.748606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788271637.749205:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586884864:0@lo:501: 10000000:01000000:2.0:1788271637.749224:0:7624:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788271637.749321:0:7624:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788271637.749327:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.749336:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.749355:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.749478:0:7624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788271637.749501:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab6ee935800 10000000:01000000:2.0:1788271637.749506:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788271637.749512:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788271637.749514:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271637.749518:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788271637.749522:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788271637.749546:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.749553:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.749562:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.749577:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586884992:0@lo:101: 00000100:00100000:2.0:1788271637.749614:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271637.749713:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad600 going to sleep for 11 seconds 00010000:00010000:0.0:1788271637.757878:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271637.757894:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.757924:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031200 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271637.757929:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.757939:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271637.757947:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271637.757953:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271637.757992:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.757998:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788271637.758090:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586885120:0@lo:103: 00000100:00100000:3.0:1788271637.758283:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.758400:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586884992 00000100:00100000:1.0:1788271637.758407:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586884992 00000100:00100000:1.0:1788271637.758436:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586885120 00000100:00100000:1.0:1788271637.758439:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586885120 00000100:00100000:1.0:1788271637.758484:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271637.758505:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3280:x1875138586885120:12345-0@lo:103: 00010000:00010000:1.0:1788271637.758517:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271637.758536:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c148a800/0xbeb05ca97b5f70a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f709d expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.758559:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271637.758623:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.758630:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f709d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbeb05ca97b5f70a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.758641:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271637.758643:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271637.758644:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271637.759303:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:3280:x1875138586885120:12345-0@lo:103: Request processed in 809us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.759312:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271637.759377:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788271637.759387:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+11:7624:x1875138586884992:12345-0@lo:101: 00010000:00010000:1.0:1788271637.759459:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271637.759474:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f70ab expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.759492:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.759502:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.759509:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148ae00, rc 0) 00000100:00100000:1.0:1788271637.759552:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586884992:12345-0@lo:101: Request processed in 166us (9937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.759559:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788271637.759595:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586884992:0@lo:101: 00010000:00010000:1.0:1788271637.759609:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.759617:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271637.759720:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885248:0@lo:501: 00000100:00100000:1.0:1788271637.759765:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.759791:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f7e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271637.759806:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586885248 00000100:00100000:1.0:1788271637.759810:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586885248 00000100:00100000:1.0:1788271637.759828:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788271637.759834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885248:12345-0@lo:501: 00000100:00100000:1.0:1788271637.760071:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885248:12345-0@lo:501: Request processed in 237us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.760078:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788271637.761514:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885248:0@lo:501: 00000100:00100000:1.0:1788271637.761566:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885376:0@lo:503: 00000100:00100000:1.0:1788271637.761627:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.761654:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4e8c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788271637.761675:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586885376 00000100:00100000:1.0:1788271637.761680:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586885376 00000100:00100000:1.0:1788271637.761711:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788271637.761718:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885376:12345-0@lo:503: 00000100:00100000:1.0:1788271637.761890:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885376:12345-0@lo:503: Request processed in 172us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.761897:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788271637.761935:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885376:0@lo:503: 00000040:00080000:1.0:1788271637.766499:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788271637.766592:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885504:0@lo:502: 00000100:00100000:1.0:1788271637.766681:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.766725:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4e8c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788271637.766777:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586885504 00000100:00100000:1.0:1788271637.766784:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586885504 00000100:00100000:1.0:1788271637.766818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271637.766827:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885504:12345-0@lo:502: 00000100:00100000:1.0:1788271637.767018:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885504:12345-0@lo:502: Request processed in 191us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.767034:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271637.767077:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885504:0@lo:502: 00000100:00100000:3.0:1788271637.770587:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586885120:0@lo:103: 00000040:00080000:1.0:1788271637.770771:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788271637.770848:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788271637.770881:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788271637.770929:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788271637.770962:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788271637.770996:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788271637.771041:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885632:0@lo:502: 00000100:00100000:1.0:1788271637.771954:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.772048:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44600 going to sleep for 11 seconds 00000100:00100000:0.0:1788271637.772095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586885632 00000100:00100000:0.0:1788271637.772167:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586885632 00000100:00100000:0.0:1788271637.772356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788271637.772366:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885632:12345-0@lo:502: 00000100:00100000:0.0:1788271637.772616:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885632:12345-0@lo:502: Request processed in 251us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.772630:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788271637.772723:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885632:0@lo:502: 00000040:00080000:1.0:1788271637.772855:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788271637.772868:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788271637.773809:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788271637.773818:0:7631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788271637.773825:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271637.773827:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788271637.773833:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271637.773848:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ab6c9f0b370) 00000020:00000080:2.0:1788271637.773867:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788271637.773881:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271637.773960:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6ee935800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788271637.773968:0:7631:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271637.773975:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbeb05ca97b5f70c0 00010000:00010000:3.0:1788271637.780037:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788271637.781512:0:7631:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788271637.784529:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788271637.784830:0:7631:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788271637.788834:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788271637.789908:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788271637.792161:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788271637.792174:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271637.792179:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271637.792182:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788271637.792185:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271637.792189:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271637.792190:0:7631:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788271637.792193:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788271637.792195:0:7631:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788271637.792241:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271637.792299:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271637.792301:0:7631:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788271637.792306:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788271637.792472:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788271637.792497:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788271637.792521:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.792533:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271637.792542:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6ee935800 from 1 10000000:01000000:1.0:1788271637.792545:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271637.792580:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.792588:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.792609:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271637.792635:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885760:0@lo:101: 00000100:00100000:1.0:1788271637.792703:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.792749:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271637.792855:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586885760 00000100:00100000:3.0:1788271637.792863:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586885760 00000100:00100000:3.0:1788271637.792912:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788271637.792922:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:7624:x1875138586885760:12345-0@lo:101: 00010000:00010000:3.0:1788271637.792934:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271637.792946:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f70c7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.792967:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.792977:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.792986:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3800, rc 0) 00000100:00100000:3.0:1788271637.793035:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586885760:12345-0@lo:101: Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271637.793041:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788271637.793240:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885760:0@lo:101: 00010000:00010000:1.0:1788271637.793261:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.793270:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271637.793351:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885888:0@lo:501: 00000100:00100000:1.0:1788271637.793376:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.793400:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271637.793552:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586885888 00000100:00100000:2.0:1788271637.793557:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586885888 00000100:00100000:2.0:1788271637.793588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788271637.793595:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586885888:12345-0@lo:501: 00000100:00100000:2.0:1788271637.793816:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586885888:12345-0@lo:501: Request processed in 221us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271637.793823:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788271637.794025:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586885888:0@lo:501: 00000100:00100000:1.0:1788271637.794054:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886016:0@lo:503: 00000100:00100000:1.0:1788271637.794091:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271637.794126:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271637.795550:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886016 00000100:00100000:2.0:1788271637.795561:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886016 00000100:00100000:2.0:1788271637.795616:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271637.795627:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586886016:12345-0@lo:503: 00000100:00100000:2.0:1788271637.796064:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586886016:12345-0@lo:503: Request processed in 437us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271637.796073:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788271637.796449:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886016:0@lo:503: 00000040:00080000:3.0:1788271637.796743:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271637.796828:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886144:0@lo:502: 00000100:00100000:3.0:1788271637.796887:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.796917:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271637.796980:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886144 00000100:00100000:0.0:1788271637.796984:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886144 00000100:00100000:0.0:1788271637.797026:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788271637.797035:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586886144:12345-0@lo:502: 00000100:00100000:0.0:1788271637.797236:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586886144:12345-0@lo:502: Request processed in 201us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.797383:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788271637.797530:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886144:0@lo:502: 00000040:00080000:3.0:1788271637.797781:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788271637.797838:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788271637.797861:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886272:0@lo:502: 00000100:00100000:3.0:1788271637.797901:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.797928:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271637.798191:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886272 00000100:00100000:0.0:1788271637.798197:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886272 00000100:00100000:0.0:1788271637.798225:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788271637.798234:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586886272:12345-0@lo:502: 00000100:00100000:0.0:1788271637.798389:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586886272:12345-0@lo:502: Request processed in 156us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.798396:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788271637.798459:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886272:0@lo:502: 00000040:00080000:0.0:1788271637.798544:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788271637.798554:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788271637.801533:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271637.801545:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271637.801547:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788271637.801554:0:7634:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6ee935800 00000020:00000080:3.0:1788271637.801557:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271637.801575:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271637.801578:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271637.801579:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788271637.801583:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788271637.801711:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788271637.801737:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271637.801771:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.801785:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271637.801828:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788271637.801837:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab6ee935800 10000000:01000000:0.0:1788271637.801840:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab6ee935800 10000000:01000000:0.0:1788271637.801845:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271637.801852:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6ee935800 from 1 10000000:01000000:0.0:1788271637.801856:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271637.801892:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.801900:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.801911:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.801932:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886400:0@lo:101: 00000100:00100000:0.0:1788271637.801995:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.802037:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de9936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271637.802061:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886400 00000100:00100000:0.0:1788271637.802067:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886400 00000100:00100000:0.0:1788271637.802175:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788271637.802186:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:7624:x1875138586886400:12345-0@lo:101: 00010000:00010000:0.0:1788271637.802199:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271637.802212:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f70d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.802236:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.802483:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.802505:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0030800, rc 0) 00000100:00100000:0.0:1788271637.804216:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886400:12345-0@lo:101: Request processed in 2024us (2213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.804229:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788271637.814639:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886400:0@lo:101: 00010000:00010000:3.0:1788271637.814666:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271637.814678:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271637.814822:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886528:0@lo:501: 00000100:00100000:3.0:1788271637.814883:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.814928:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271637.815405:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886528 00000100:00100000:2.0:1788271637.815810:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886528 00000100:00100000:2.0:1788271637.815858:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788271637.815867:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886528:12345-0@lo:501: 00000100:00100000:2.0:1788271637.817011:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886528:12345-0@lo:501: Request processed in 1140us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271637.817021:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788271637.817122:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886528:0@lo:501: 00000100:00100000:3.0:1788271637.817168:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886656:0@lo:503: 00000100:00100000:3.0:1788271637.817215:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.820612:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271637.827577:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886656 00000100:00100000:2.0:1788271637.827595:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886656 00000100:00100000:2.0:1788271637.827661:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788271637.827673:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886656:12345-0@lo:503: 00000100:00100000:2.0:1788271637.827949:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886656:12345-0@lo:503: Request processed in 278us (10733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271637.827958:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788271637.828106:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886656:0@lo:503: 00000040:00080000:3.0:1788271637.828395:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271637.828492:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886784:0@lo:502: 00000100:00100000:3.0:1788271637.828536:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.828566:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271637.829091:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886784 00000100:00100000:2.0:1788271637.829106:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886784 00000100:00100000:2.0:1788271637.829133:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788271637.829140:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886784:12345-0@lo:502: 00000100:00100000:2.0:1788271637.829318:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886784:12345-0@lo:502: Request processed in 177us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271637.829325:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788271637.829530:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886784:0@lo:502: 00000040:00080000:3.0:1788271637.829788:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788271637.829832:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788271637.829864:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788271637.829906:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788271637.829939:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788271637.829993:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788271637.830027:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788271637.830060:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788271637.830112:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788271637.830145:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788271637.830174:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788271637.830216:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788271637.830262:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788271637.830304:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788271637.830349:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788271637.830381:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788271637.830442:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788271637.830490:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788271637.830526:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788271637.830557:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788271637.830599:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788271637.830628:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788271637.830659:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788271637.830702:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788271637.830734:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788271637.830778:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788271637.830821:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788271637.830856:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788271637.830902:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788271637.830951:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788271637.830987:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788271637.831020:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788271637.831051:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788271637.831093:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788271637.831129:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788271637.831171:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788271637.831206:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788271637.831248:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886912:0@lo:502: 00000100:00100000:3.0:1788271637.831311:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.831347:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271637.831567:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586886912 00000100:00100000:1.0:1788271637.831576:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586886912 00000100:00100000:1.0:1788271637.831642:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788271637.831652:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886912:12345-0@lo:502: 00000100:00100000:1.0:1788271637.831878:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586886912:12345-0@lo:502: Request processed in 227us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.831891:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788271637.832844:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586886912:0@lo:502: 00000040:00080000:3.0:1788271637.832950:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788271637.832962:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788271637.834903:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788271637.834921:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ab6c57ab370) 00000020:00000080:1.0:1788271637.834944:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788271637.835036:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6ee935800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788271637.835041:0:7636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6ee935800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788271637.835044:0:7636:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6ee935800 3 00010000:00080000:1.0:1788271637.835083:0:7636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6ca68a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.101@tcp at head 00010000:00010000:1.0:1788271637.836728:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788271637.836946:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788271637.836979:0:7636:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788271637.836992:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbeb05ca97b5f70ea 00000100:00080000:1.0:1788271637.837001:0:7636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271637.837006:0:7636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6ca68a000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1788271637.837038:0:7636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ee3b1f80 x1875138586887040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271637.837066:0:7636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788271637.839168:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271637.839189:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586887168:0@lo:400: 00000100:00100000:2.0:1788271637.839253:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271637.839299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887168 00000100:00100000:2.0:1788271637.839305:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887168 00000100:00100000:2.0:1788271637.839350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271637.839360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586887168:12345-0@lo:400: 00000100:00100000:2.0:1788271637.839430:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586887168:12345-0@lo:400: Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271637.839437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788271637.839568:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc165180 x1875138586887168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271637.839580:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586887168:0@lo:400: 00000100:00100000:0.0:1788271637.839746:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586887296:0@lo:400: 00000100:00100000:0.0:1788271637.839790:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.839817:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271637.839823:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586887424:0@lo:400: 00000100:00100000:0.0:1788271637.839849:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.839881:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875138586887040:0@lo:38: 00000100:00100000:0.0:1788271637.839909:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.839953:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887424 00000100:00100000:0.0:1788271637.839958:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887424 00000100:00100000:0.0:1788271637.839997:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271637.840004:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586887424:12345-0@lo:400: 00000100:00100000:0.0:1788271637.840041:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586887424:12345-0@lo:400: Request processed in 37us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.840047:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788271637.840062:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788271637.840080:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc165c00 x1875138586887424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271637.840091:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586887424:0@lo:400: 00000100:00100000:0.0:1788271637.840117:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887296 00000100:00100000:0.0:1788271637.840121:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887296 00000100:00100000:0.0:1788271637.840145:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887040 00000100:00100000:0.0:1788271637.840155:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887040 00000100:00100000:0.0:1788271637.840169:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271637.840175:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586887296:12345-0@lo:400: 00000100:00100000:0.0:1788271637.840209:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586887296:12345-0@lo:400: Request processed in 34us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.840214:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271637.840226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271637.840230:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875138586887040:12345-0@lo:38: 00010000:00080000:0.0:1788271637.840250:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1788271637.840283:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbeb05ca97b5f70f1 00000004:00100000:0.0:1788271637.840298:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788271637.840327:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3070800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271637.840366:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875138586887040:12345-0@lo:38: Request processed in 134us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.840372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788271637.840385:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788271637.840400:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6cc164e00 x1875138586887296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271637.840431:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586887296:0@lo:400: 00010000:00080000:0.0:1788271637.840455:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ee3b1f80 x1875138586887040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271637.840464:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271637.840470:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788271637.840477:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788271637.840482:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788271637.840484:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca68a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271637.840497:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875138586887040:0@lo:38: 00000040:00080000:1.0:1788271637.847351:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788271637.847549:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788271637.847577:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271637.847597:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.847621:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788271637.847684:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788271637.847686:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271637.847688:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271637.847690:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271637.847691:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271637.847692:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271637.847694:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271637.847695:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271637.847697:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271637.847699:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271637.847700:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271637.847704:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788271637.847706:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271637.847708:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271637.847709:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271637.847710:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271637.847711:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271637.847712:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271637.847714:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271637.847715:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271637.847716:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271637.847717:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271637.847718:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271637.847746:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788271637.847777:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586887552:0@lo:253: 00000100:00100000:2.0:1788271637.847851:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271637.847899:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6caaa4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271637.848021:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1875138586887680:0@lo:901: 00000100:00100000:3.0:1788271637.848066:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.848082:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271637.848850:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887552 00000100:00100000:1.0:1788271637.848860:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887552 00000100:00100000:1.0:1788271637.848911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788271637.848921:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586887552:12345-0@lo:253: 20000000:01000000:1.0:1788271637.848946:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788271637.848959:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788271637.849658:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887680 00000100:00100000:1.0:1788271637.849665:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887680 00000100:00100000:1.0:1788271637.849713:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271637.849722:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1875138586887680:12345-0@lo:901: 00000100:00100000:1.0:1788271637.850053:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1875138586887680:12345-0@lo:901: Request processed in 331us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.850061:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788271637.850497:0:7638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6c9f79500 x1875138586887680/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788271653 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271637.850513:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1875138586887680:0@lo:901: 00000100:00080000:0.0:1788271637.850687:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1788271637.884606:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788271637.884629:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788271637.884691:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788271637.884696:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788271637.884716:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.884766:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.884774:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.884814:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271637.884828:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271637.884843:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875138586887808:0@lo:104: 00000100:00100000:2.0:1788271637.884909:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271637.884999:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61cc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271637.891172:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:7624:x1875138586887552:12345-0@lo:253: Request processed in 42240us (43309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.891189:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788271637.891399:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e92ad5e1-0f38-442e-8a6a-19627f637d27:7624:1875138586887552:0@lo:253: 10000000:01000000:2.0:1788271637.891447:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788271637.891452:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271637.891453:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271637.891455:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271637.891456:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271637.891457:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271637.891458:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271637.891459:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271637.891461:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271637.891462:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271637.891464:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271637.891466:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788271637.891483:0:7624:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788271637.892743:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887808 00000100:00100000:1.0:1788271637.892765:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887808 00000100:00100000:1.0:1788271637.892829:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271637.892840:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5853:x1875138586887808:12345-0@lo:104: 00010000:00010000:1.0:1788271637.892856:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.892938:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271637.892944:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:5853:x1875138586887808:12345-0@lo:104: Request processed in 107us (8036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271637.892951:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788271637.892976:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271637.892982:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.892990:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d2000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271637.892994:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.893003:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271637.893026:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271637.893032:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271637.893067:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.893074:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788271637.893236:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875138586887808:0@lo:104: 00010000:00010000:0.0:1788271637.893325:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.893368:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.893376:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f7042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7049 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.893396:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271637.893398:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271637.893400:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271637.893409:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271637.893602:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586887936:0@lo:103: 00000100:00100000:1.0:1788271637.893645:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271637.896084:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586887936 00000100:00100000:0.0:1788271637.896103:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586887936 00010000:00010000:0.0:1788271637.896150:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271637.896192:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271637.896202:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:3281:x1875138586887936:12345-0@lo:103: 00010000:00010000:0.0:1788271637.896217:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271637.896222:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896237:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896360:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f7049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f7042 expref: 14 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896378:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896386:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788271637.896444:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011749343s 00010000:00010000:0.0:1788271637.896450:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896458:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896464:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896471:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896478:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271637.896482:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896491:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896511:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271637.896522:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271637.896601:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3281:x1875138586887936:12345-0@lo:103: Request processed in 400us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271637.896610:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271637.896729:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586887936:0@lo:103: 00010000:00010000:1.0:1788271637.896773:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.896781:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271637.896788:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024be00/0xbeb05ca97b5f70f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788271637.898961:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788271637.899301:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271637.899932:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271637.900203:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271637.900909:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271637.901219:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788271637.902883:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788271638.098649:0:7624:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788271638.098656:0:7624:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788271638.098690:0:7624:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788271638.098741:0:7624:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788271638.098769:0:7624:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788271638.098796:0:7624:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788271638.514768:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271639.545300:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271640.562725:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271640.562783:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271640.562809:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586888064:0@lo:13: 00000100:00100000:3.0:1788271640.562879:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271640.562996:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888064 00000100:00100000:1.0:1788271640.563005:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888064 00000100:00100000:1.0:1788271640.563068:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271640.563077:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586888064:12345-0@lo:13: 00002000:00000024:1.0:1788271640.563124:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271640.563181:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586888064:12345-0@lo:13: Request processed in 105us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271640.563188:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788271640.563226:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b3480 x1875138586888064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271640.563244:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586888064:0@lo:13: 00000100:00080000:3.0:1788271640.563459:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788271641.587507:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271642.617959:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271643.122590:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586888192:0@lo:400: 00000100:00100000:0.0:1788271643.122676:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271643.122779:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271643.122786:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586888320:0@lo:400: 00000100:00100000:0.0:1788271643.122815:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271643.122849:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888192 00000100:00100000:0.0:1788271643.122856:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888192 00000100:00100000:0.0:1788271643.122902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271643.122911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3278:x1875138586888192:12345-0@lo:400: 00000100:00100000:0.0:1788271643.122969:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:3278:x1875138586888192:12345-0@lo:400: Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271643.122975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271643.123010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888320 00000100:00100000:0.0:1788271643.123013:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888320 00000100:00100000:0.0:1788271643.123038:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271643.123044:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586888320:12345-0@lo:400: 00000100:00100000:0.0:1788271643.123088:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586888320:12345-0@lo:400: Request processed in 44us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271643.123094:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788271643.123129:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cc164000 x1875138586888320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271643.123141:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586888320:0@lo:400: 00000100:00100000:0.0:1788271643.123150:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586888192:0@lo:400: 00000100:00100000:2.0:1788271643.126929:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586888448:0@lo:400: 00000100:00100000:3.0:1788271643.127121:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586888704:0@lo:400: 00000100:00100000:3.0:1788271643.130656:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271643.130735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888704 00000100:00100000:3.0:1788271643.130744:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888704 00000100:00100000:3.0:1788271643.130797:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788271643.130808:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586888704:12345-0@lo:400: 00000100:00100000:3.0:1788271643.130862:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586888704:12345-0@lo:400: Request processed in 56us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271643.130869:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788271643.130890:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788271643.131027:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cc167100 x1875138586888704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271643.131055:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586888704:0@lo:400: 00000100:00100000:2.0:1788271643.132928:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271643.133022:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271643.133034:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586888576:0@lo:400: 00000100:00100000:2.0:1788271643.133068:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271643.133115:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888576 00000100:00100000:2.0:1788271643.133121:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888576 00000100:00100000:2.0:1788271643.133172:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271643.133181:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586888576:12345-0@lo:400: 00000100:00100000:2.0:1788271643.133228:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586888576:12345-0@lo:400: Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271643.133235:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788271643.135065:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788271643.135126:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cc164000 x1875138586888576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271643.135141:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586888576:0@lo:400: 00000100:00100000:0.0:1788271643.139576:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888448 00000100:00100000:0.0:1788271643.139592:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888448 00000100:00100000:0.0:1788271643.139693:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271643.139704:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586888448:12345-0@lo:400: 00000100:00100000:0.0:1788271643.139795:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586888448:12345-0@lo:400: Request processed in 93us (6871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271643.139802:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788271643.139847:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cc165180 x1875138586888448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271643.139862:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586888448:0@lo:400: 00000100:00080000:3.0:1788271643.139923:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271643.635914:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271644.506690:0:7979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788271644.660183:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788271645.682569:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788271645.682578:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c914a800 from 30 10000000:01000000:0.0:1788271645.682584:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271645.682646:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.682659:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.682671:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271645.682695:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586888832:0@lo:101: 00000100:00100000:0.0:1788271645.682765:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.682824:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271645.683087:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586888960:0@lo:13: 00000100:00100000:2.0:1788271645.683123:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.683335:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888832 00000100:00100000:3.0:1788271645.683343:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888832 00000100:00100000:3.0:1788271645.683390:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788271645.683400:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586888832:12345-0@lo:101: 00010000:00010000:3.0:1788271645.683426:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271645.683438:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f70ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.683460:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.683471:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.683480:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d2200, rc 0) 00000100:00100000:3.0:1788271645.683514:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586888832:12345-0@lo:101: Request processed in 115us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.683520:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788271645.683640:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586888960 00000100:00100000:1.0:1788271645.683644:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586888960 00000100:00100000:1.0:1788271645.683678:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271645.683684:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586888960:12345-0@lo:13: 00002000:00000024:1.0:1788271645.683710:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271645.683856:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586888832:0@lo:101: 00010000:00010000:0.0:1788271645.683871:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.683895:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271645.683943:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889088:0@lo:501: 00000100:00100000:0.0:1788271645.683979:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.684009:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.684343:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889088 00000100:00100000:3.0:1788271645.684348:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889088 00000100:00100000:3.0:1788271645.684381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788271645.684389:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586889088:12345-0@lo:501: 00000100:00100000:3.0:1788271645.684653:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586889088:12345-0@lo:501: Request processed in 264us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.684660:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788271645.684757:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889088:0@lo:501: 00000100:00100000:0.0:1788271645.684785:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889216:0@lo:503: 00000100:00100000:0.0:1788271645.684821:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.684860:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.685062:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889216 00000100:00100000:3.0:1788271645.685066:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889216 00000100:00100000:3.0:1788271645.685099:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788271645.685107:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586889216:12345-0@lo:503: 00000100:00100000:3.0:1788271645.685286:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586889216:12345-0@lo:503: Request processed in 179us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.685293:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788271645.685378:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889216:0@lo:503: 00000100:00100000:0.0:1788271645.685829:0:8051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8051:1875138586889344:0@lo:502: 00000100:00100000:0.0:1788271645.685881:0:8051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.685912:0:8051:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.685969:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889344 00000100:00100000:3.0:1788271645.685974:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889344 00000100:00100000:3.0:1788271645.686003:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788271645.686011:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8051:x1875138586889344:12345-0@lo:502: 00000100:00100000:3.0:1788271645.686191:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8051:x1875138586889344:12345-0@lo:502: Request processed in 179us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.686198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788271645.686283:0:8051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8051:1875138586889344:0@lo:502: 00000100:00100000:0.0:1788271645.686321:0:8051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8051:1875138586889472:0@lo:502: 00000100:00100000:0.0:1788271645.686353:0:8051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.686374:0:8051:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.686485:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889472 00000100:00100000:3.0:1788271645.686490:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889472 00000100:00100000:3.0:1788271645.686520:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788271645.686527:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8051:x1875138586889472:12345-0@lo:502: 00000100:00100000:3.0:1788271645.686681:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8051:x1875138586889472:12345-0@lo:502: Request processed in 154us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.686687:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788271645.686770:0:8051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8051:1875138586889472:0@lo:502: 00000040:00080000:0.0:1788271645.686790:0:8051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788271645.687100:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788271645.687115:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271645.687124:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.687134:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271645.687155:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788271645.687158:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788271645.687160:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788271645.687185:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.687193:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.687203:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271645.687217:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889600:0@lo:101: 00000100:00100000:3.0:1788271645.687248:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.687280:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271645.687328:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889600 00000100:00100000:0.0:1788271645.687333:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889600 00000100:00100000:0.0:1788271645.687365:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788271645.687373:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586889600:12345-0@lo:101: 00010000:00010000:0.0:1788271645.687387:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271645.687399:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f710d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.687454:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.687464:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.687473:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0031c00, rc 0) 00000100:00100000:0.0:1788271645.687506:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586889600:12345-0@lo:101: Request processed in 134us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.687512:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788271645.687555:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889600:0@lo:101: 00010000:00010000:0.0:1788271645.687567:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.687576:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271645.687625:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889728:0@lo:501: 00000100:00100000:0.0:1788271645.687649:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.687662:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271645.687672:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889728 00000100:00100000:0.0:1788271645.687675:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889728 00000100:00100000:0.0:1788271645.687692:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788271645.687698:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586889728:12345-0@lo:501: 00000100:00100000:0.0:1788271645.688369:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586889728:12345-0@lo:501: Request processed in 668us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.688377:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788271645.688453:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889728:0@lo:501: 00000100:00100000:3.0:1788271645.688482:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889856:0@lo:503: 00000100:00100000:3.0:1788271645.688520:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.688548:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c92920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271645.688661:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586888960:12345-0@lo:13: Request processed in 4976us (5536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271645.688670:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788271645.688693:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271645.688704:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271645.688815:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889856 00000100:00100000:0.0:1788271645.688820:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889856 00000100:00100000:0.0:1788271645.688859:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788271645.688866:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586889856:12345-0@lo:503: 00000100:00100000:0.0:1788271645.689243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586889856:12345-0@lo:503: Request processed in 377us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.689251:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1788271645.689389:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b3480 x1875138586888960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271645.689408:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586888960:0@lo:13: 00000100:00100000:3.0:1788271645.689561:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586889856:0@lo:503: 00000100:00100000:1.0:1788271645.690215:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8052:1875138586889984:0@lo:502: 00000100:00100000:1.0:1788271645.690266:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.690333:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271645.690374:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586889984 00000100:00100000:0.0:1788271645.690380:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586889984 00000100:00100000:0.0:1788271645.690487:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788271645.690496:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8052:x1875138586889984:12345-0@lo:502: 00000100:00100000:0.0:1788271645.690729:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8052:x1875138586889984:12345-0@lo:502: Request processed in 234us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.690736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788271645.690877:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8052:1875138586889984:0@lo:502: 00000020:01000000:2.0:1788271645.690901:0:8052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271645.690911:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271645.690913:0:8052:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271645.690918:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271645.690925:0:8052:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788271645.690942:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8052:1875138586890112:0@lo:502: 00000100:00100000:2.0:1788271645.690989:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271645.691646:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.691743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586890112 00000100:00100000:3.0:1788271645.691750:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586890112 00000100:00100000:3.0:1788271645.691778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788271645.691787:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8052:x1875138586890112:12345-0@lo:502: 00000100:00100000:3.0:1788271645.692080:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8052:x1875138586890112:12345-0@lo:502: Request processed in 293us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.692096:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788271645.692184:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8052:1875138586890112:0@lo:502: 00000020:01000000:2.0:1788271645.692208:0:8052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271645.692213:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271645.692215:0:8052:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271645.692218:0:8052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788271645.692396:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788271645.692442:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788271645.692452:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.692463:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271645.692472:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788271645.692475:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c9170000 from 30 10000000:01000000:3.0:1788271645.692478:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271645.692502:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.692511:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.692522:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271645.692538:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890240:0@lo:101: 00000100:00100000:3.0:1788271645.692570:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.692589:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271645.692657:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586890240 00000100:00100000:0.0:1788271645.692661:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586890240 00000100:00100000:0.0:1788271645.692685:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788271645.692692:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586890240:12345-0@lo:101: 00010000:00010000:0.0:1788271645.692701:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271645.692711:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f711b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.692731:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.692752:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271645.692761:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0030e00, rc 0) 00000100:00100000:0.0:1788271645.692798:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586890240:12345-0@lo:101: Request processed in 107us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.692804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788271645.692990:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890240:0@lo:101: 00010000:00010000:3.0:1788271645.693002:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.693011:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271645.693057:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890368:0@lo:501: 00000100:00100000:3.0:1788271645.693082:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.693111:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271645.693204:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586890368 00000100:00100000:0.0:1788271645.693208:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586890368 00000100:00100000:0.0:1788271645.693237:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788271645.693243:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586890368:12345-0@lo:501: 00000100:00100000:0.0:1788271645.693482:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586890368:12345-0@lo:501: Request processed in 238us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.693489:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788271645.693587:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890368:0@lo:501: 00000100:00100000:3.0:1788271645.693624:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890496:0@lo:503: 00000100:00100000:3.0:1788271645.693660:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.693690:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271645.693734:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586890496 00000100:00100000:0.0:1788271645.693738:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586890496 00000100:00100000:0.0:1788271645.693794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788271645.693802:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586890496:12345-0@lo:503: 00000100:00100000:3.0:1788271645.694267:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890496:0@lo:503: 00000100:00100000:3.0:1788271645.694499:0:8053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8053:1875138586890624:0@lo:502: 00000100:00100000:3.0:1788271645.694534:0:8053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.694640:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586890496:12345-0@lo:503: Request processed in 155us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.694650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788271645.694779:0:8053:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271645.694830:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586890624 00000100:00100000:1.0:1788271645.694851:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586890624 00000100:00100000:1.0:1788271645.694876:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788271645.694884:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8053:x1875138586890624:12345-0@lo:502: 00000100:00100000:1.0:1788271645.695097:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8053:x1875138586890624:12345-0@lo:502: Request processed in 212us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271645.695103:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788271645.695264:0:8053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8053:1875138586890624:0@lo:502: 00000100:00100000:3.0:1788271645.695306:0:8053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8053:1875138586890752:0@lo:502: 00000100:00100000:3.0:1788271645.695338:0:8053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.695362:0:8053:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271645.695501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586890752 00000100:00100000:1.0:1788271645.695505:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586890752 00000100:00100000:1.0:1788271645.695525:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788271645.695531:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8053:x1875138586890752:12345-0@lo:502: 00000100:00100000:1.0:1788271645.695678:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8053:x1875138586890752:12345-0@lo:502: Request processed in 146us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271645.695684:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788271645.695766:0:8053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8053:1875138586890752:0@lo:502: 00000040:00080000:3.0:1788271645.695785:0:8053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788271645.696068:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788271645.696085:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788271645.696094:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.696104:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271645.696114:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788271645.696116:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6c9170000 from 5 10000000:01000000:1.0:1788271645.696119:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788271645.696145:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.696152:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.696172:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271645.696186:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890880:0@lo:101: 00000100:00100000:1.0:1788271645.696216:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.696251:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.696302:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586890880 00000100:00100000:3.0:1788271645.696307:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586890880 00000100:00100000:3.0:1788271645.696327:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788271645.696334:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586890880:12345-0@lo:101: 00010000:00010000:3.0:1788271645.696343:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271645.696355:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7129 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.696383:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7129 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.696393:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7129 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.696402:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3600, rc 0) 00000100:00100000:3.0:1788271645.696469:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586890880:12345-0@lo:101: Request processed in 135us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.696475:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788271645.696555:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586890880:0@lo:101: 00010000:00010000:1.0:1788271645.696566:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.696574:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271645.696623:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891008:0@lo:256: 00000100:00100000:1.0:1788271645.696654:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.696680:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.696726:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891008 00000100:00100000:3.0:1788271645.696730:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891008 00000100:00100000:3.0:1788271645.696746:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788271645.696753:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586891008:12345-0@lo:256: 20000000:01000000:3.0:1788271645.696765:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788271645.696783:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788271645.696786:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788271645.697076:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586891008:12345-0@lo:256: Request processed in 323us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.697083:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788271645.697151:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891008:0@lo:256: 10000000:01000000:1.0:1788271645.697190:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788271645.697196:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.697203:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271645.697210:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788271645.697212:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788271645.697220:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788271645.697235:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.697243:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.697250:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271645.697262:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891136:0@lo:101: 00000100:00100000:1.0:1788271645.697287:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.697307:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.697357:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891136 00000100:00100000:3.0:1788271645.697361:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891136 00000100:00100000:3.0:1788271645.697380:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788271645.697386:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586891136:12345-0@lo:101: 00010000:00010000:3.0:1788271645.697393:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271645.697402:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7137 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.697459:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.697467:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.697474:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3a00, rc 0) 00000100:00100000:3.0:1788271645.697499:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586891136:12345-0@lo:101: Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.697505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788271645.697625:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891136:0@lo:101: 00010000:00010000:1.0:1788271645.697637:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.697646:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271645.697690:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891264:0@lo:501: 00000100:00100000:1.0:1788271645.697716:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.697744:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788271645.698232:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891264 00000100:00100000:0.0:1788271645.698238:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891264 00000100:00100000:0.0:1788271645.698260:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788271645.698269:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586891264:12345-0@lo:501: 00000100:00100000:0.0:1788271645.698556:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586891264:12345-0@lo:501: Request processed in 287us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.698569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788271645.698687:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891264:0@lo:501: 00000100:00100000:1.0:1788271645.698720:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891392:0@lo:503: 00000100:00100000:1.0:1788271645.698759:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.698785:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.698879:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891392 00000100:00100000:3.0:1788271645.698883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891392 00000100:00100000:3.0:1788271645.698903:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788271645.698910:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586891392:12345-0@lo:503: 00000100:00100000:3.0:1788271645.699136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586891392:12345-0@lo:503: Request processed in 225us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.699143:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788271645.699220:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586891392:0@lo:503: 00000100:00100000:1.0:1788271645.699872:0:8054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8054:1875138586891520:0@lo:502: 00000100:00100000:1.0:1788271645.699920:0:8054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.699967:0:8054:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.700093:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891520 00000100:00100000:3.0:1788271645.700099:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891520 00000100:00100000:3.0:1788271645.700123:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788271645.700131:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8054:x1875138586891520:12345-0@lo:502: 00000100:00100000:3.0:1788271645.700394:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8054:x1875138586891520:12345-0@lo:502: Request processed in 262us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.700401:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788271645.700524:0:8054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8054:1875138586891520:0@lo:502: 00000020:01000000:1.0:1788271645.700550:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271645.700558:0:8054:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788271645.700565:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271645.700568:0:8054:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788271645.700573:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788271645.700577:0:8054:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:1.0:1788271645.700603:0:8054:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788271645.700606:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271645.700633:0:8054:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ab6c57a99b8) 00000020:00000080:1.0:1788271645.700655:0:8054:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788271645.700661:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788271645.700726:0:8054:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788271645.700731:0:8054:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788271645.700737:0:8054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f714c 00010000:00080000:1.0:1788271645.700785:0:8054:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6eda3c800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:1.0:1788271645.701154:0:8054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788271645.701497:0:8054:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788271645.701509:0:8054:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788271645.702293:0:8054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271645.702671:0:8054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271645.702727:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788271645.702783:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788271645.703507:0:8055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271645.703512:0:8055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788271645.704301:0:8054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271645.704313:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788271645.704344:0:8054:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788271645.704372:0:8054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f7153 00000100:00080000:1.0:1788271645.704382:0:8054:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271645.704388:0:8054:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab6eda3c800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1788271645.704598:0:8054:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ee3b1880 x1875138586891648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271645.704659:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586891648:0@lo:8: 00000100:00100000:0.0:1788271645.704730:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271645.704811:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891648 00000100:00100000:2.0:1788271645.704819:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891648 00000100:00100000:2.0:1788271645.704863:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271645.704871:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875138586891648:12345-0@lo:8: 00010000:00080000:2.0:1788271645.704895:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788271645.704920:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f715a 00002000:00100000:2.0:1788271645.704932:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ab6ee234000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788271645.704936:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788271645.704939:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788271645.705052:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788271645.705190:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788271645.705213:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee236800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788271645.705324:0:8054:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788271645.705444:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586891904:0@lo:400: 00000100:00100000:1.0:1788271645.705477:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.705499:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271645.705505:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586891776:0@lo:400: 00000100:00100000:1.0:1788271645.705525:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.705546:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271645.705554:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586892032:0@lo:400: 00000100:00100000:1.0:1788271645.705576:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788271645.705654:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271645.705659:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271645.705661:0:8054:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788271645.705664:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271645.705668:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271645.705670:0:8054:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788271645.705672:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788271645.705674:0:8054:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788271645.705695:0:8054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8054:1875138586892160:0@lo:502: 00000100:00100000:1.0:1788271645.705740:0:8054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.705754:0:8054:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.705856:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891904 00000100:00100000:3.0:1788271645.705861:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891904 00000100:00100000:3.0:1788271645.705893:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586891776 00000100:00100000:3.0:1788271645.705901:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586891776 00000100:00100000:3.0:1788271645.705915:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892032 00000100:00100000:3.0:1788271645.705917:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892032 00000100:00100000:3.0:1788271645.705929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271645.705935:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586891904:12345-0@lo:400: 00000100:00100000:3.0:1788271645.705988:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586891904:12345-0@lo:400: Request processed in 52us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.705995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271645.706011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271645.706017:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586891776:12345-0@lo:400: 00000100:00100000:3.0:1788271645.706043:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586891776:12345-0@lo:400: Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.706049:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271645.706060:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271645.706066:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586892032:12345-0@lo:400: 00000100:00100000:3.0:1788271645.706097:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586892032:12345-0@lo:400: Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.706103:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788271645.706133:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b2d80 x1875138586892032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271645.706145:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586892032:0@lo:400: 00010000:00080000:3.0:1788271645.706172:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b2680 x1875138586891776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271645.706180:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586891776:0@lo:400: 00010000:00080000:3.0:1788271645.706194:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b2300 x1875138586891904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271645.706212:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586891904:0@lo:400: 00000100:00100000:3.0:1788271645.706233:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892160 00000100:00100000:3.0:1788271645.706236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892160 00000100:00100000:3.0:1788271645.706260:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788271645.706266:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8054:x1875138586892160:12345-0@lo:502: 00000100:00100000:3.0:1788271645.706503:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8054:x1875138586892160:12345-0@lo:502: Request processed in 235us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.706510:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1788271645.706678:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271645.706700:0:8054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8054:1875138586892160:0@lo:502: 00000020:01000000:1.0:1788271645.706725:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271645.706734:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271645.706736:0:8054:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788271645.706740:0:8054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1788271645.707018:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875138586891648:12345-0@lo:8: Request processed in 2145us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271645.707027:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:3.0:1788271645.707153:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788271645.707170:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788271645.707179:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.707190:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271645.707199:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788271645.707203:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab6e59d0000 from 1 10000000:01000000:3.0:1788271645.707206:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788271645.707233:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.707241:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271645.707249:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271645.707278:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586892288:0@lo:101: 00000100:00100000:3.0:1788271645.707312:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.707378:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6cb752b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271645.707409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892288 00000100:00100000:1.0:1788271645.707524:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892288 00000100:00100000:1.0:1788271645.707561:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788271645.707570:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586892288:12345-0@lo:101: 00010000:00010000:1.0:1788271645.707580:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271645.707592:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.707624:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.707635:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271645.707644:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148b400, rc 0) 00000100:00100000:1.0:1788271645.707748:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586892288:12345-0@lo:101: Request processed in 179us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271645.707755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788271645.707849:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b1880 x1875138586891648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271645.707860:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271645.707866:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788271645.707874:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788271645.707879:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788271645.707882:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6eda3c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788271645.707937:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788271645.707943:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586891648:0@lo:8: 00000100:00100000:2.0:1788271645.710903:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586892288:0@lo:101: 00010000:00010000:2.0:1788271645.710941:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271645.710954:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271645.711043:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586892416:0@lo:501: 00000100:00100000:2.0:1788271645.711103:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271645.711143:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271645.711161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892416 00000100:00100000:2.0:1788271645.711166:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892416 00000100:00100000:2.0:1788271645.711204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788271645.711214:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586892416:12345-0@lo:501: 00000100:00100000:2.0:1788271645.711409:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586892416:12345-0@lo:501: Request processed in 196us (305us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271645.711439:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788271645.711476:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc165180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586892416:0@lo:501: 10000000:01000000:2.0:1788271645.711500:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788271645.711506:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271645.711515:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271645.712750:0:8055:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788271645.713247:0:8055:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208894832882ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788271645.743333:0:8056:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788271645.743366:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586892672:0@lo:7: 00000100:00100000:3.0:1788271645.743473:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.743503:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f7ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271645.743518:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271645.743529:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586892544:0@lo:13: 00000100:00100000:3.0:1788271645.743554:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.743744:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892544 00000100:00100000:1.0:1788271645.743752:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892544 00000100:00100000:1.0:1788271645.743803:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271645.743812:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586892544:12345-0@lo:13: 00002000:00000024:1.0:1788271645.743844:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788271645.743893:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586892544:12345-0@lo:13: Request processed in 81us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271645.743900:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788271645.743927:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788271645.743956:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6c9f79c00 x1875138586892544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271645.744337:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586892544:0@lo:13: 00000100:00100000:2.0:1788271645.746354:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892672 00000100:00100000:2.0:1788271645.746369:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892672 00000100:00100000:2.0:1788271645.746569:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271645.746580:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8056:x1875138586892672:12345-0@lo:7: 00002000:00080000:2.0:1788271645.755573:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788271645.755581:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788271645.755695:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8056:x1875138586892672:12345-0@lo:7: Request processed in 9113us (12218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271645.755706:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788271645.755841:0:8056:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6c9f7a680 x1875138586892672/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788271661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271645.755856:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586892672:0@lo:7: 00000004:00080000:0.0:1788271645.755869:0:8056:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788271645.755909:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586892800:0@lo:5: 00000100:00100000:0.0:1788271645.755945:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271645.756053:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c551e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271645.756793:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892800 00000100:00100000:2.0:1788271645.756802:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892800 00000100:00100000:2.0:1788271645.757104:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788271645.757114:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8056:x1875138586892800:12345-0@lo:5: 00002000:00080000:2.0:1788271645.757141:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788271645.757145:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788271645.757433:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8056:x1875138586892800:12345-0@lo:5: Request processed in 320us (1487us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788271645.757441:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788271645.757508:0:8056:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6fe9ca680 x1875138586892800/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271645.757522:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586892800:0@lo:5: 00000004:00080000:1.0:1788271645.757533:0:8056:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788271645.757562:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586892928:0@lo:700: 00000100:00100000:1.0:1788271645.757592:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.757631:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271645.757646:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586892928 00000100:00100000:1.0:1788271645.757650:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586892928 00000100:00100000:1.0:1788271645.757678:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271645.757685:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8056:x1875138586892928:12345-0@lo:700: 00000100:00100000:1.0:1788271645.757713:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1875138586893056:0@lo:700: 00000100:00100000:1.0:1788271645.757740:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271645.757756:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271645.763842:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893056 00000100:00100000:2.0:1788271645.763857:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893056 00000100:00100000:2.0:1788271645.763911:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271645.763921:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1875138586893056:12345-0@lo:700: 00000004:00080000:1.0:1788271645.787797:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788271645.841362:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788271645.852093:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1875138586893056:12345-0@lo:700: Request processed in 88165us (94342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271645.852109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788271645.852769:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b0e00 x1875138586893056/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788271661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271645.852789:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1875138586893056:0@lo:700: 40000000:02000000:0.0:1788271645.852804:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788271645.936632:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788271645.936648:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788271645.937552:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8056:x1875138586892928:12345-0@lo:700: Request processed in 179861us (179953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271645.937565:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788271645.938331:0:8056:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b2a00 x1875138586892928/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788271661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271645.938344:0:8056:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788271645.938358:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586892928:0@lo:700: 00000004:02000040:3.0:1788271645.967160:0:8056:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788271645.970254:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f7b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586893184:0@lo:5: 00000100:00100000:3.0:1788271645.970323:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.970371:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893184 00000100:00100000:3.0:1788271645.970379:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893184 00000100:00100000:3.0:1788271645.970448:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271645.970457:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8056:x1875138586893184:12345-0@lo:5: 00000100:00100000:1.0:1788271645.975000:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820540 going to sleep for 11 seconds 00002000:00080000:3.0:1788271645.982064:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788271645.982087:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788271645.987371:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8056:x1875138586893184:12345-0@lo:5: Request processed in 16909us (17041us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788271645.987384:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788271645.987887:0:8056:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6c9f7b480 x1875138586893184/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271645.987928:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f7b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8056:1875138586893184:0@lo:5: 00000004:00080000:1.0:1788271645.987941:0:8056:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788271646.706617:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271647.736269:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271648.755124:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788271649.116291:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788271649.737379:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271649.737474:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574286976 00000100:00100000:1.0:1788271649.737495:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574286976 00000100:00100000:1.0:1788271649.737551:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:1.0:1788271649.737560:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1875138574286976:12345-192.168.201.1@tcp:250: 00010000:00080000:1.0:1788271649.737594:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 248429c1-4bc1-48f2-96f4-7358aba5f110@192.168.201.1@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1788271649.737624:0:5831:0:(genops.c:1385:class_connect()) connect: client 248429c1-4bc1-48f2-96f4-7358aba5f110, cookie 0xbeb05ca97b5f716f 00000100:00080000:1.0:1788271649.737764:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8ab6eda38000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271649.737835:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+5:2350:x1875138574286976:12345-192.168.201.1@tcp:250: Request processed in 275us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.737843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:0.0:1788271649.748460:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271649.748797:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574287104 00000100:00100000:1.0:1788271649.748809:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574287104 00000100:00100000:1.0:1788271649.748866:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:1.0:1788271649.748877:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+5:5581:x1875138574287104:12345-192.168.201.1@tcp:101: 00010000:00010000:1.0:1788271649.748908:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271649.748929:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023733 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.748960:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.748972:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.749283:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6a00, rc 0) 00000100:00100000:1.0:1788271649.749359:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+6:5581:x1875138574287104:12345-192.168.201.1@tcp:101: Request processed in 483us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.749367:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:0.0:1788271649.755762:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271649.755912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574287232 00000100:00100000:2.0:1788271649.755928:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574287232 00000100:00100000:2.0:1788271649.755979:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:2.0:1788271649.756079:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+6:5581:x1875138574287232:12345-192.168.201.1@tcp:501: 00000100:00100000:2.0:1788271649.756523:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+6:5581:x1875138574287232:12345-192.168.201.1@tcp:501: Request processed in 446us (768us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271649.756532:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:0.0:1788271649.760304:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271649.760388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574287360 00000100:00100000:1.0:1788271649.760407:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574287360 00000100:00100000:1.0:1788271649.760489:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:1.0:1788271649.760498:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+6:5581:x1875138574287360:12345-192.168.201.1@tcp:101: 00010000:00010000:1.0:1788271649.760513:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271649.760529:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x76932646102373a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.760564:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.760576:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.760586:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7200, rc 0) 00000100:00100000:1.0:1788271649.760636:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+7:5581:x1875138574287360:12345-192.168.201.1@tcp:101: Request processed in 138us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.760643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:2.0:1788271649.772976:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271649.773268:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574287488 00000100:00100000:3.0:1788271649.773278:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574287488 00000100:00100000:3.0:1788271649.773327:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:3.0:1788271649.773338:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+7:5581:x1875138574287488:12345-192.168.201.1@tcp:501: 00000100:00100000:3.0:1788271649.773665:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5581:x1875138574287488:12345-192.168.201.1@tcp:501: Request processed in 328us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.773673:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 116 00010000:00010000:1.0:1788271649.778703:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271649.788299:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271649.788337:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574287616 00000100:00100000:0.0:1788271649.788347:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574287616 00000100:00100000:0.0:1788271649.788392:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:0.0:1788271649.788402:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5581:x1875138574287616:12345-192.168.201.1@tcp:503: 00000100:00100000:0.0:1788271649.788791:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5581:x1875138574287616:12345-192.168.201.1@tcp:503: Request processed in 387us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.788800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:0.0:1788271649.797083:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271649.797133:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574287744 00000100:00100000:0.0:1788271649.797143:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574287744 00000100:00100000:0.0:1788271649.797187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:0.0:1788271649.797197:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5600:x1875138574287744:12345-192.168.201.1@tcp:502: 00000100:00100000:0.0:1788271649.798317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5600:x1875138574287744:12345-192.168.201.1@tcp:502: Request processed in 1114us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.798328:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:0.0:1788271649.838750:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271649.838783:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574287872 00000100:00100000:0.0:1788271649.838793:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574287872 00000100:00100000:0.0:1788271649.838840:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:0.0:1788271649.838849:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5600:x1875138574287872:12345-192.168.201.1@tcp:502: 00000100:00100000:0.0:1788271649.839091:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5600:x1875138574287872:12345-192.168.201.1@tcp:502: Request processed in 241us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.839105:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:0.0:1788271649.857299:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271649.857429:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288000 00000100:00100000:3.0:1788271649.857440:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288000 00000100:00100000:3.0:1788271649.857504:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:3.0:1788271649.857516:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5581:x1875138574288000:12345-192.168.201.1@tcp:101: 00010000:00010000:3.0:1788271649.857537:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271649.857574:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f7184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023764 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.857609:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f7184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023764 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.857620:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f7184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023764 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.857640:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d2a00, rc 0) 00000100:00100000:3.0:1788271649.857709:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5581:x1875138574288000:12345-192.168.201.1@tcp:101: Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.857734:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:0.0:1788271649.867995:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271649.868081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288128 00000100:00100000:1.0:1788271649.868091:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288128 00000100:00100000:1.0:1788271649.868145:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1788271649.868155:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5581:x1875138574288128:12345-192.168.201.1@tcp:256: 20000000:01000000:1.0:1788271649.868180:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788271649.868204:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788271649.868208:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788271649.868211:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788271649.868214:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788271649.879124:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5581:x1875138574288128:12345-192.168.201.1@tcp:256: Request processed in 10957us (11126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.879152:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:0.0:1788271649.887152:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271649.887253:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288256 00000100:00100000:1.0:1788271649.887266:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288256 00000100:00100000:1.0:1788271649.887332:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:1.0:1788271649.887343:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5581:x1875138574288256:12345-192.168.201.1@tcp:101: 00010000:00010000:1.0:1788271649.887361:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271649.887379:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76932646102376b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.887409:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.887439:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.887448:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7000, rc 0) 00000100:00100000:1.0:1788271649.887498:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5581:x1875138574288256:12345-192.168.201.1@tcp:101: Request processed in 157us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.887505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:3.0:1788271649.908677:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271649.908726:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288384 00000100:00100000:3.0:1788271649.908739:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288384 00000100:00100000:3.0:1788271649.908795:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:3.0:1788271649.908805:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5581:x1875138574288384:12345-192.168.201.1@tcp:501: 00000100:00100000:3.0:1788271649.910031:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5581:x1875138574288384:12345-192.168.201.1@tcp:501: Request processed in 1221us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.910042:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:0.0:1788271649.916119:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271649.916386:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288512 00000100:00100000:3.0:1788271649.916397:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288512 00000100:00100000:3.0:1788271649.916464:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:3.0:1788271649.916475:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5581:x1875138574288512:12345-192.168.201.1@tcp:503: 00000100:00100000:3.0:1788271649.916881:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5581:x1875138574288512:12345-192.168.201.1@tcp:503: Request processed in 406us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.916902:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:2.0:1788271649.929813:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271649.932231:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288640 00000100:00100000:3.0:1788271649.932247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288640 00000100:00100000:3.0:1788271649.932317:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:3.0:1788271649.932328:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5604:x1875138574288640:12345-192.168.201.1@tcp:502: 00000100:00100000:3.0:1788271649.932619:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5604:x1875138574288640:12345-192.168.201.1@tcp:502: Request processed in 292us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.932643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:2.0:1788271649.941372:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271649.941595:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288768 00000100:00100000:2.0:1788271649.941604:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288768 00000100:00100000:2.0:1788271649.941701:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:2.0:1788271649.941713:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5604:x1875138574288768:12345-192.168.201.1@tcp:502: 00000100:00100000:2.0:1788271649.941935:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5604:x1875138574288768:12345-192.168.201.1@tcp:502: Request processed in 223us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.941942:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:2.0:1788271649.966814:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271649.967744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574288896 00000100:00100000:3.0:1788271649.967761:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574288896 00000100:00100000:3.0:1788271649.967858:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1788271649.967869:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875138574288896:12345-192.168.201.1@tcp:38: 00010000:00080000:3.0:1788271649.967910:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1788271649.967976:0:5837:0:(genops.c:1385:class_connect()) connect: client 896349b1-dd1e-47e2-bcd1-0ecd5d75458e, cookie 0xbeb05ca97b5f7192 00000004:00100000:3.0:1788271649.968021:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:3.0:1788271649.968030:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788271650.035257:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8ab6e5827800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271650.035353:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2350:x1875138574288896:12345-192.168.201.1@tcp:38: Request processed in 67482us (68557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271650.035365:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:0.0:1788271650.544232:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271650.544283:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271650.544392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289152 00000100:00100000:2.0:1788271650.544403:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289152 00000100:00100000:2.0:1788271650.544504:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289024 00000100:00100000:2.0:1788271650.544508:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289024 00000100:00100000:2.0:1788271650.544527:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1788271650.544550:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:5581:x1875138574289152:12345-192.168.201.1@tcp:41: 00000004:00000024:2.0:1788271650.544610:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788271650.544689:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:5581:x1875138574289152:12345-192.168.201.1@tcp:41: Request processed in 139us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271650.544697:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1788271650.544733:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1788271650.544739:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:0:x1875138574289024:12345-192.168.201.1@tcp:41: 00000004:00000024:2.0:1788271650.544751:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788271650.544772:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:0:x1875138574289024:12345-192.168.201.1@tcp:41: Request processed in 34us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271650.544778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00080000:0.0:1788271650.545222:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271650.547380:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271650.547564:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289280 00000100:00100000:0.0:1788271650.547574:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289280 00000100:00100000:0.0:1788271650.547639:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1788271650.547651:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:5581:x1875138574289280:12345-192.168.201.1@tcp:40: 00000100:00100000:0.0:1788271650.547751:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:5581:x1875138574289280:12345-192.168.201.1@tcp:40: Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271650.547759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:3.0:1788271650.552077:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271650.552125:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271650.552236:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271650.552245:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289664 00000100:00100000:1.0:1788271650.552256:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289664 00000100:00100000:1.0:1788271650.552328:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1788271650.552339:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:5581:x1875138574289664:12345-192.168.201.1@tcp:33: 00000100:00100000:2.0:1788271650.563785:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289408 00000100:00100000:2.0:1788271650.563803:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289408 00000100:00100000:2.0:1788271650.566554:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289536 00000100:00100000:2.0:1788271650.566570:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289536 00000100:00100000:0.0:1788271650.569022:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:0.0:1788271650.569035:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875138574289408:12345-192.168.201.1@tcp:8: 00010000:00080000:0.0:1788271650.569073:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788271650.569109:0:6700:0:(genops.c:1385:class_connect()) connect: client 896349b1-dd1e-47e2-bcd1-0ecd5d75458e, cookie 0xbeb05ca97b5f7199 00002000:00100000:0.0:1788271650.569124:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 896349b1-dd1e-47e2-bcd1-0ecd5d75458e/ffff8ab6c3070000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271650.569163:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788271650.572820:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788271650.573714:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3075800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271650.573811:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2350:x1875138574289408:12345-192.168.201.1@tcp:8: Request processed in 4774us (21683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271650.573837:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:0.0:1788271650.573873:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:0.0:1788271650.573880:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875138574289536:12345-192.168.201.1@tcp:8: 00010000:00080000:0.0:1788271650.573905:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788271650.575452:0:6700:0:(genops.c:1385:class_connect()) connect: client 896349b1-dd1e-47e2-bcd1-0ecd5d75458e, cookie 0xbeb05ca97b5f71a0 00002000:00100000:0.0:1788271650.575472:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 896349b1-dd1e-47e2-bcd1-0ecd5d75458e/ffff8ab6c3073000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271650.575497:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788271650.577514:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788271650.581791:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3076800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271650.581902:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2350:x1875138574289536:12345-192.168.201.1@tcp:8: Request processed in 8016us (29661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271650.581915:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000004:00080000:1.0:1788271650.599381:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 46923us 00000004:00200000:3.0:1788271650.617818:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788271650.618334:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:5581:x1875138574289664:12345-192.168.201.1@tcp:33: Request processed in 65990us (66260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271650.618350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1788271650.803811:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271650.803842:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586893312:0@lo:13: 00000100:00100000:3.0:1788271650.803920:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271650.804122:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893312 00000100:00100000:1.0:1788271650.804131:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893312 00000100:00100000:1.0:1788271650.804201:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271650.804225:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586893312:12345-0@lo:13: 00002000:00000024:1.0:1788271650.804249:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271650.804298:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586893312:12345-0@lo:13: Request processed in 74us (377us total) trans 0 rc 0/0 00000100:00080000:3.0:1788271650.804516:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788271650.804585:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b2a00 x1875138586893312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271650.804595:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788271650.804612:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586893312:0@lo:13: 00000100:00100000:1.0:1788271650.804839:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788271650.806830:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271650.806849:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586893824:0@lo:400: 00000100:00100000:0.0:1788271650.806926:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271650.806962:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788271650.806968:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586893440:0@lo:400: 00000100:00100000:0.0:1788271650.806998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271650.807023:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586893952:0@lo:400: 00000100:00100000:0.0:1788271650.807046:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271650.807070:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586893696:0@lo:400: 00000100:00100000:0.0:1788271650.807096:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271650.807116:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271650.807121:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586893568:0@lo:400: 00000100:00100000:0.0:1788271650.807152:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271650.807180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893952 00000100:00100000:0.0:1788271650.807187:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893952 00000100:00100000:0.0:1788271650.807231:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893696 00000100:00100000:0.0:1788271650.807234:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893696 00000100:00100000:0.0:1788271650.807246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893568 00000100:00100000:0.0:1788271650.807248:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893568 00000100:00100000:0.0:1788271650.807261:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271650.807269:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586893952:12345-0@lo:400: 00000100:00100000:0.0:1788271650.807318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586893952:12345-0@lo:400: Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271650.807325:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271650.807353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788271650.807358:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586893696:12345-0@lo:400: 00000100:00100000:0.0:1788271650.807389:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586893696:12345-0@lo:400: Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271650.807395:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788271650.807408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788271650.807436:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586893568:12345-0@lo:400: 00000100:00100000:2.0:1788271650.807660:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893824 00000100:00100000:2.0:1788271650.807665:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893824 00000100:00100000:2.0:1788271650.807698:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271650.807707:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586893824:12345-0@lo:400: 00000100:00100000:1.0:1788271650.807736:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586894080:0@lo:13: 00000100:00100000:2.0:1788271650.807746:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586893824:12345-0@lo:400: Request processed in 40us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271650.807753:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271650.807789:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271650.807792:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586893440 00000100:00100000:2.0:1788271650.807797:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586893440 00000100:00100000:2.0:1788271650.807834:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788271650.807836:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894080 00000100:00100000:2.0:1788271650.807842:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586893440:12345-0@lo:400: 00000100:00100000:1.0:1788271650.807842:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894080 00000100:00100000:1.0:1788271650.807875:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271650.807885:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586894080:12345-0@lo:13: 00000100:00100000:2.0:1788271650.807890:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586893440:12345-0@lo:400: Request processed in 49us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271650.807897:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00002000:00000024:1.0:1788271650.807902:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271650.807947:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586894080:12345-0@lo:13: Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271650.807955:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788271650.807959:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6fe9caa00 x1875138586893568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271650.807974:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586893568:0@lo:400: 00010000:00080000:2.0:1788271650.808000:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff348700 x1875138586893696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271650.808009:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586893696:0@lo:400: 00010000:00080000:1.0:1788271650.808036:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b0e00 x1875138586894080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271650.808048:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586893440:0@lo:400: 00000100:00100000:1.0:1788271650.808056:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586894080:0@lo:13: 00010000:00080000:2.0:1788271650.808068:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff348000 x1875138586893952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271650.808079:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586893952:0@lo:400: 00010000:00080000:2.0:1788271650.808089:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34b800 x1875138586893824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271650.808096:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586893824:0@lo:400: 00000100:00100000:0.0:1788271650.808196:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586893568:12345-0@lo:400: Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271650.808205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788271650.808314:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271650.808320:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271650.809807:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271650.809974:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289792 00000100:00100000:2.0:1788271650.809982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289792 00000100:00100000:2.0:1788271650.810038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1788271650.810049:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:5621:x1875138574289792:12345-192.168.201.1@tcp:101: 00010000:00010000:2.0:1788271650.810069:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271650.810097:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f71a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023795 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271650.810162:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f71ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271650.810176:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f71ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271650.810191:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f71ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271650.810407:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788271650.810675:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271650.810764:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f71ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271650.810792:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f71a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023795 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271650.810810:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f71ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023795 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271650.810819:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64a00) 00010000:00010000:2.0:1788271650.810823:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271650.810826:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a400, rc 0) 00000100:00100000:2.0:1788271650.810888:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:5621:x1875138574289792:12345-192.168.201.1@tcp:101: Request processed in 841us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271650.810895:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00010000:00010000:1.0:1788271651.834678:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271651.925963:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000100:00100000:2.0:1788271652.770582:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271652.770741:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574289920 00000100:00100000:1.0:1788271652.770750:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574289920 00000100:00100000:1.0:1788271652.770871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271652.770883:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:5673:x1875138574289920:12345-192.168.201.1@tcp:41: 00000004:00000024:1.0:1788271652.770929:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788271652.771014:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:5673:x1875138574289920:12345-192.168.201.1@tcp:41: Request processed in 133us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271652.771038:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00080000:3.0:1788271652.771472:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271652.776514:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271652.776615:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290048 00000100:00100000:1.0:1788271652.776630:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290048 00000100:00100000:1.0:1788271652.776723:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:1.0:1788271652.776734:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:5673:x1875138574290048:12345-192.168.201.1@tcp:13: 00002000:00000024:1.0:1788271652.776774:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271652.776866:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:5673:x1875138574290048:12345-192.168.201.1@tcp:13: Request processed in 123us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271652.776874:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00080000:3.0:1788271652.776957:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271652.789348:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271652.789572:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290176 00000100:00100000:1.0:1788271652.789586:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290176 00000100:00100000:1.0:1788271652.789802:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271652.789813:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:5673:x1875138574290176:12345-192.168.201.1@tcp:13: 00002000:00000024:1.0:1788271652.789859:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271652.789942:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:5673:x1875138574290176:12345-192.168.201.1@tcp:13: Request processed in 130us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271652.789950:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00080000:3.0:1788271652.790348:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788271652.854677:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271653.875711:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271654.905978:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788271655.479944:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000001:02000400:1.0:1788271655.495091:0:8290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788271655.499456:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000100:00100000:3.0:1788271655.922878:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271655.922930:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586894208:0@lo:400: 00000100:00100000:3.0:1788271655.923007:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271655.923093:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894208 00000100:00100000:3.0:1788271655.923102:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894208 00000100:00100000:3.0:1788271655.923149:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788271655.923159:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586894208:12345-0@lo:400: 00000100:00100000:3.0:1788271655.923240:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586894208:12345-0@lo:400: Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271655.923248:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788271655.923296:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586894208:0@lo:400: 00000100:00100000:2.0:1788271655.923608:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586894592:0@lo:400: 00000100:00100000:2.0:1788271655.923644:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271655.923668:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271655.923673:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586894720:0@lo:400: 00000100:00100000:2.0:1788271655.923699:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271655.923726:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894720 00000100:00100000:2.0:1788271655.923731:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894720 00000100:00100000:2.0:1788271655.923788:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788271655.923898:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586894464:0@lo:400: 00000100:00100000:3.0:1788271655.923928:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271655.923948:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788271655.923954:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586894336:0@lo:400: 00000100:00100000:3.0:1788271655.923976:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271655.923987:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586894848:0@lo:400: 00000100:00100000:3.0:1788271655.924018:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271655.924062:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788271655.924070:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788271655.924083:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271655.924183:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894464 00000100:00100000:3.0:1788271655.924187:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894464 00000100:00100000:3.0:1788271655.924211:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788271655.924216:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894336 00000100:00100000:3.0:1788271655.924219:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894336 00000100:00100000:3.0:1788271655.924229:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788271655.924234:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271655.924240:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586894464:12345-0@lo:400: 00000100:00100000:3.0:1788271655.924279:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586894464:12345-0@lo:400: Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271655.924285:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271655.924296:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788271655.924300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271655.924305:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586894336:12345-0@lo:400: 00000100:00100000:3.0:1788271655.924331:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586894336:12345-0@lo:400: Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271655.924337:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788271655.924350:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271655.924370:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586894336:0@lo:400: 00000100:00100000:3.0:1788271655.924380:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586894464:0@lo:400: 00000100:00100000:3.0:1788271655.924564:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894592 00000100:00100000:3.0:1788271655.924568:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894592 00000100:00100000:3.0:1788271655.924597:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894848 00000100:00100000:3.0:1788271655.924600:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894848 00000100:00100000:3.0:1788271655.924615:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271655.924621:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586894592:12345-0@lo:400: 00000100:00100000:3.0:1788271655.924666:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586894592:12345-0@lo:400: Request processed in 45us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271655.924673:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271655.924686:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271655.924692:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586894848:12345-0@lo:400: 00000100:00100000:3.0:1788271655.924724:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586894848:12345-0@lo:400: Request processed in 32us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271655.924730:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788271655.924744:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271655.924747:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271655.924767:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f780ca80 x1875138586894848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271655.924779:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586894848:0@lo:400: 00010000:00080000:3.0:1788271655.924840:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f780c000 x1875138586894592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271655.924849:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586894592:0@lo:400: 00000100:00100000:2.0:1788271655.925289:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586894720:12345-0@lo:400: 00000100:00100000:2.0:1788271655.925343:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586894720:12345-0@lo:400: Request processed in 60us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271655.925350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788271655.925530:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586894720:0@lo:400: 00000100:00100000:3.0:1788271655.925707:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586894976:0@lo:13: 00000100:00100000:3.0:1788271655.925744:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271655.925839:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271655.925848:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586895104:0@lo:13: 00000100:00100000:0.0:1788271655.925883:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271655.926079:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586894976 00000100:00100000:2.0:1788271655.926085:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586894976 00000100:00100000:2.0:1788271655.926108:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586895104 00000100:00100000:2.0:1788271655.926111:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586895104 00000100:00100000:2.0:1788271655.926126:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271655.926136:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586894976:12345-0@lo:13: 00002000:00000024:2.0:1788271655.926173:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00010000:1.0:1788271655.926283:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271655.928953:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586894976:12345-0@lo:13: Request processed in 2647us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271655.928967:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271655.929005:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271655.929020:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586895104:12345-0@lo:13: 00002000:00000024:2.0:1788271655.929055:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271655.929122:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586895104:12345-0@lo:13: Request processed in 110us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271655.929129:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788271655.929225:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff349f80 x1875138586895104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271655.929247:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586895104:0@lo:13: 00010000:00080000:3.0:1788271655.930604:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b0e00 x1875138586894976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271655.930630:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586894976:0@lo:13: 00000100:00100000:0.0:1788271656.043539:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271656.043590:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271656.043625:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271656.043660:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271656.043691:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290688 00000100:00100000:0.0:1788271656.043700:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290688 00000100:00100000:0.0:1788271656.043755:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290560 00000100:00100000:0.0:1788271656.043759:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290560 00000100:00100000:0.0:1788271656.043781:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:0.0:1788271656.043801:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574290688:12345-192.168.201.1@tcp:400: 00000100:00100000:0.0:1788271656.043873:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574290688:12345-192.168.201.1@tcp:400: Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271656.043881:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:0.0:1788271656.043912:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1788271656.043919:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574290560:12345-192.168.201.1@tcp:400: 00000100:00100000:0.0:1788271656.043947:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574290560:12345-192.168.201.1@tcp:400: Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271656.043954:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00080000:0.0:1788271656.043971:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271656.043988:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271656.044127:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290304 00000100:00100000:0.0:1788271656.044132:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290304 00000100:00100000:0.0:1788271656.044173:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 129 00000100:00100000:0.0:1788271656.044181:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574290304:12345-192.168.201.1@tcp:400: 00000100:00100000:0.0:1788271656.044212:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574290304:12345-192.168.201.1@tcp:400: Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271656.044217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 129 00000100:00100000:3.0:1788271656.044668:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290432 00000100:00100000:3.0:1788271656.044673:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290432 00000100:00100000:3.0:1788271656.044720:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:3.0:1788271656.044728:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574290432:12345-192.168.201.1@tcp:400: 00000100:00100000:3.0:1788271656.044817:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574290432:12345-192.168.201.1@tcp:400: Request processed in 91us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271656.044824:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00080000:0.0:1788271656.048850:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271656.954644:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271657.970717:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788271658.820140:0:8440:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff619ab060 20000000:00000080:2.0:1788271658.820165:0:8440:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab6ee0b3400 uarg=0000000000000000 20000000:01000000:2.0:1788271658.820214:0:8440:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788271658.820217:0:8440:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788271658.820220:0:8440:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788271658.820226:0:8440:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788271658.820232:0:8440:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788271658.820259:0:8440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788271658.820262:0:8440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788271658.824092:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788271658.824102:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788271658.825597:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788271658.826110:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788271658.826176:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788271658.826233:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788271658.826249:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788271658.826252:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788271658.828821:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788271658.830897:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788271658.830985:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788271658.831031:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788271658.831050:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788271658.831054:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788271658.832651:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788271658.834061:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788271658.834125:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788271658.834154:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788271658.834167:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788271658.834170:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788271658.836317:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788271658.837288:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788271658.837365:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788271658.837471:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788271658.837493:0:8440:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788271658.837521:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837545:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837553:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837638:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837646:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837654:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837661:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837679:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837689:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837698:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.837707:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.838466:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.838490:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 9 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271658.838511:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895232:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271658.839159:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.839172:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 9 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.839182:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895360:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271658.839220:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.839229:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 18 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.839238:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895488:0@lo:104: 00000100:00100000:1.0:1788271658.839285:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271658.839333:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.839342:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 18 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.839350:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895616:0@lo:104: 00000100:00100000:1.0:1788271658.839377:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271658.843989:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.844013:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 18 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.844033:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895744:0@lo:104: 00010000:00010000:1.0:1788271658.844135:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.844143:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 18 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.844152:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895872:0@lo:104: 00010000:00010000:1.0:1788271658.844183:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.844192:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 18 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.844200:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586896000:0@lo:104: 00010000:00010000:1.0:1788271658.844227:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.844234:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 18 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.844241:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586896128:0@lo:104: 00010000:00010000:1.0:1788271658.844263:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.844284:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 18 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.844293:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586896256:0@lo:104: 00000100:00100000:1.0:1788271658.844312:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271658.844483:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788271658.844517:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.844535:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.844544:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.844553:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.844562:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.844576:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586895488 00000100:00100000:2.0:1788271658.844585:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586895488 00000100:00100000:2.0:1788271658.844640:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586895616 00000100:00100000:2.0:1788271658.844643:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586895616 00000100:00100000:2.0:1788271658.844658:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586895744 00000100:00100000:2.0:1788271658.844660:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586895744 00000100:00100000:2.0:1788271658.844669:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586895872 00000100:00100000:2.0:1788271658.844671:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586895872 00000100:00100000:2.0:1788271658.844678:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896000 00000100:00100000:2.0:1788271658.844680:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896000 00000100:00100000:2.0:1788271658.844690:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896128 00000100:00100000:2.0:1788271658.844692:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896128 00000100:00100000:2.0:1788271658.844701:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896256 00000100:00100000:2.0:1788271658.844703:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896256 00000100:00100000:2.0:1788271658.844717:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271658.844730:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:8440:x1875138586895488:12345-0@lo:104: 00010000:00010000:2.0:1788271658.844744:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.844817:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788271658.844824:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+9:8440:x1875138586895488:12345-0@lo:104: Request processed in 98us (5540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.844832:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271658.844866:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271658.844873:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+8:8440:x1875138586895616:12345-0@lo:104: 00010000:00010000:2.0:1788271658.844881:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.844924:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788271658.844929:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+8:8440:x1875138586895616:12345-0@lo:104: Request processed in 58us (5552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.844936:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271658.844974:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271658.844982:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+7:8440:x1875138586895744:12345-0@lo:104: 00010000:00010000:2.0:1788271658.844989:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845017:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788271658.845022:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+7:8440:x1875138586895744:12345-0@lo:104: Request processed in 42us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.845028:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271658.845040:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271658.845046:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:8440:x1875138586895872:12345-0@lo:104: 00010000:00010000:2.0:1788271658.845054:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845080:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788271658.845084:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+6:8440:x1875138586895872:12345-0@lo:104: Request processed in 39us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.845090:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271658.845112:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271658.845118:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:8440:x1875138586896000:12345-0@lo:104: 00010000:00010000:2.0:1788271658.845126:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845155:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788271658.845160:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:8440:x1875138586896000:12345-0@lo:104: Request processed in 43us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.845166:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271658.845178:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271658.845185:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:8440:x1875138586896128:12345-0@lo:104: 00010000:00010000:2.0:1788271658.845192:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845219:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788271658.845223:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:8440:x1875138586896128:12345-0@lo:104: Request processed in 40us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.845229:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271658.845241:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788271658.845247:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:8440:x1875138586896256:12345-0@lo:104: 00010000:00010000:2.0:1788271658.845255:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845282:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788271658.845286:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:8440:x1875138586896256:12345-0@lo:104: Request processed in 40us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.845292:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788271658.845326:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788271658.845333:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845341:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d2400 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271658.845346:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845356:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.845364:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.845371:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.845451:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845458:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.845483:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845490:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2400/0xbeb05ca97b5f7161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845509:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788271658.845512:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845518:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148a600 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271658.845521:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845536:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.845544:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.845549:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.845563:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845569:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.845586:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845593:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a600/0xbeb05ca97b5f7137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f713e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845603:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788271658.845606:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845612:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d3000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271658.845615:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845623:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.845629:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.845642:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.845655:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845660:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.845665:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845671:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f711b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845680:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788271658.845683:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845689:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d2000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271658.845691:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845697:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.845703:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.845709:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.845719:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845724:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.845735:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845742:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2000/0xbeb05ca97b5f710d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7114 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845751:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788271658.845754:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845761:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031600 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271658.845763:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845770:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.845777:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.845783:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.845795:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845800:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.845803:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845809:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f70ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845818:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271658.845827:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845833:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031200 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271658.845835:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845842:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.845848:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.845854:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.845865:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845871:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.845875:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845881:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f70d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70dc expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845890:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271658.845893:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845899:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024aa00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271658.845902:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845918:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.845925:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.845931:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.845945:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845951:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.845956:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845963:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f70ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.845978:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.845980:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.845982:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271658.846012:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586896384:0@lo:103: 00000100:00100000:2.0:1788271658.846059:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.846101:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586896896:0@lo:103: 00000100:00100000:2.0:1788271658.846124:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.846147:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271658.846153:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586896768:0@lo:103: 00000100:00100000:2.0:1788271658.846177:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.846205:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586896512:0@lo:103: 00000100:00100000:2.0:1788271658.846237:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.846249:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586897024:0@lo:103: 00000100:00100000:2.0:1788271658.846267:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.846279:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788271658.846284:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586896640:0@lo:103: 00000100:00100000:2.0:1788271658.846303:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.846312:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586897152:0@lo:103: 00000100:00100000:2.0:1788271658.846334:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.846356:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896384 00000100:00100000:2.0:1788271658.846364:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896384 00010000:00010000:2.0:1788271658.846410:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 19 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.846459:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896896 00000100:00100000:2.0:1788271658.846462:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896896 00010000:00010000:2.0:1788271658.846473:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 20 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.846483:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896768 00000100:00100000:2.0:1788271658.846485:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896768 00010000:00010000:2.0:1788271658.846495:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 21 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.846504:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896512 00000100:00100000:2.0:1788271658.846507:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896512 00010000:00010000:2.0:1788271658.846516:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 22 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.846524:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897024 00000100:00100000:2.0:1788271658.846526:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897024 00010000:00010000:2.0:1788271658.846545:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 23 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.846555:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586896640 00000100:00100000:2.0:1788271658.846558:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586896640 00010000:00010000:2.0:1788271658.846567:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 24 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.846576:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897152 00000100:00100000:2.0:1788271658.846578:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897152 00010000:00010000:2.0:1788271658.846586:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 25 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.846600:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271658.846608:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+25:3279:x1875138586896384:12345-0@lo:103: 00010000:00010000:2.0:1788271658.846620:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.846626:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 25 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846636:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 25 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846656:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.846689:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+25:3279:x1875138586896384:12345-0@lo:103: Request processed in 82us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.846697:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271658.846713:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271658.846719:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+24:3279:x1875138586896896:12345-0@lo:103: 00010000:00010000:2.0:1788271658.846726:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.846730:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 24 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846744:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 24 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846755:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.846778:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+24:3279:x1875138586896896:12345-0@lo:103: Request processed in 59us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.846785:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271658.846798:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271658.846804:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+23:3279:x1875138586896768:12345-0@lo:103: 00010000:00010000:2.0:1788271658.846812:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.846816:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 23 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846825:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 23 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846834:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.846854:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+23:3279:x1875138586896768:12345-0@lo:103: Request processed in 50us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.846860:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271658.846871:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271658.846877:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+22:3280:x1875138586896512:12345-0@lo:103: 00010000:00010000:2.0:1788271658.846885:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.846889:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 22 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846897:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 22 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846912:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.846939:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+22:3280:x1875138586896512:12345-0@lo:103: Request processed in 62us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.846945:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271658.846957:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271658.846963:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+21:3280:x1875138586897024:12345-0@lo:103: 00010000:00010000:2.0:1788271658.846971:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.846976:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 21 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846984:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 21 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.846992:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.847011:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+21:3280:x1875138586897024:12345-0@lo:103: Request processed in 48us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.847017:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271658.847028:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271658.847033:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3280:x1875138586896640:12345-0@lo:103: 00010000:00010000:2.0:1788271658.847039:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.847044:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 20 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.847052:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 20 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.847061:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.847088:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3280:x1875138586896640:12345-0@lo:103: Request processed in 54us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.847094:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271658.847107:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788271658.847113:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586897152:12345-0@lo:103: 00010000:00010000:2.0:1788271658.847120:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.847125:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 19 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.847133:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 19 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.847142:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.847162:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586897152:12345-0@lo:103: Request processed in 50us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.847168:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788271658.847238:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586896768:0@lo:103: 00000100:00100000:2.0:1788271658.847249:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586896384:0@lo:103: 00000100:00100000:2.0:1788271658.847257:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586896896:0@lo:103: 00000100:00100000:2.0:1788271658.847288:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586896640:0@lo:103: 00000100:00100000:2.0:1788271658.847295:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586897152:0@lo:103: 00000100:00100000:2.0:1788271658.847302:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586896512:0@lo:103: 00000100:00100000:2.0:1788271658.847308:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586897024:0@lo:103: 00010000:00010000:0.0:1788271658.847726:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271658.848005:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c148b400/0xbeb05ca97b5f7168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f7161 expref: 18 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.848026:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895488:0@lo:104: 00010000:00010000:1.0:1788271658.848039:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3a00/0xbeb05ca97b5f713e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f7137 expref: 17 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.848051:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895616:0@lo:104: 00010000:00010000:1.0:1788271658.848061:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f711b expref: 16 pid: 5831 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.848070:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895744:0@lo:104: 00010000:00010000:1.0:1788271658.848080:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f7114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f710d expref: 15 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.848089:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895872:0@lo:104: 00010000:00010000:1.0:1788271658.848099:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2200/0xbeb05ca97b5f7106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ff expref: 14 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.848109:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586896000:0@lo:104: 00010000:00010000:1.0:1788271658.848119:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0030800/0xbeb05ca97b5f70dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f70d5 expref: 13 pid: 5832 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.848141:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586896128:0@lo:104: 00010000:00010000:1.0:1788271658.848154:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c148ae00/0xbeb05ca97b5f70b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f70ab expref: 12 pid: 5830 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.848163:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586896256:0@lo:104: 00000100:00100000:0.0:1788271658.850494:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271658.850524:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271658.850669:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290816 00000100:00100000:2.0:1788271658.850681:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290816 00010000:00010000:2.0:1788271658.850751:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 10 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.850786:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574290944 00000100:00100000:2.0:1788271658.850789:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574290944 00010000:00010000:2.0:1788271658.850802:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.850817:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:2.0:1788271658.850827:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:2353:x1875138574290816:12345-192.168.201.1@tcp:103: 00010000:00010000:2.0:1788271658.850845:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.850851:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 11 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.850865:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 11 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.850889:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.850965:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:2353:x1875138574290816:12345-192.168.201.1@tcp:103: Request processed in 138us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.850972:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:2.0:1788271658.850992:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:2.0:1788271658.850999:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2353:x1875138574290944:12345-192.168.201.1@tcp:103: 00010000:00010000:2.0:1788271658.851006:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271658.851010:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 10 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851019:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 10 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851043:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851052:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851068:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851075:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851083:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851089:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851095:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271658.851101:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851109:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851118:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.851129:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271658.851147:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2353:x1875138574290944:12345-192.168.201.1@tcp:103: Request processed in 149us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271658.851162:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00010000:00010000:1.0:1788271658.853034:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f717d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x76932646102373a expref: 9 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.853060:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895232:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271658.853078:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f7176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023733 expref: 8 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.853086:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875138586895360:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271658.853144:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.853156:0:8440:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.853162:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.853168:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0031000/0xbeb05ca97b5f71b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.003701:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271660.022323:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788271660.466743:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788271660.466755:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6ee935800 from 39 10000000:01000000:2.0:1788271660.466764:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788271660.466832:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271660.466847:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271660.466861:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271660.466891:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897280:0@lo:101: 00000100:00100000:2.0:1788271660.467119:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.467276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897280 00000100:00100000:3.0:1788271660.467287:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897280 00000100:00100000:3.0:1788271660.467367:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788271660.467380:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+12:5834:x1875138586897280:12345-0@lo:101: 00010000:00010000:3.0:1788271660.467400:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271660.467444:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d3200/0xbeb05ca97b5f71c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f71bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.467474:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d3200/0xbeb05ca97b5f71c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71bc expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.467486:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d3200/0xbeb05ca97b5f71c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71bc expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.467498:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d3200, rc 0) 00000100:00100000:2.0:1788271660.467867:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.468029:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586897280:12345-0@lo:101: Request processed in 649us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.468038:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788271660.468274:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897280:0@lo:101: 00010000:00010000:2.0:1788271660.468295:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271660.468307:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271660.468394:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897408:0@lo:501: 00000100:00100000:2.0:1788271660.468446:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.468468:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271660.468470:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897408 00000100:00100000:0.0:1788271660.468476:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897408 00000100:00100000:0.0:1788271660.468514:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788271660.468524:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586897408:12345-0@lo:501: 00000100:00100000:0.0:1788271660.468866:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586897408:12345-0@lo:501: Request processed in 343us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271660.468883:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788271660.468890:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897408:0@lo:501: 00000100:00100000:3.0:1788271660.468999:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897536:0@lo:503: 00000100:00100000:3.0:1788271660.469117:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.469145:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271660.469335:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897536 00000100:00100000:0.0:1788271660.469340:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897536 00000100:00100000:0.0:1788271660.469381:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788271660.469389:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586897536:12345-0@lo:503: 00000100:00100000:0.0:1788271660.469579:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586897536:12345-0@lo:503: Request processed in 189us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271660.469586:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788271660.469710:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897536:0@lo:503: 00000100:00100000:2.0:1788271660.470116:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8456:1875138586897664:0@lo:502: 00000100:00100000:2.0:1788271660.470157:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.470192:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271660.470442:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897664 00000100:00100000:0.0:1788271660.470447:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897664 00000100:00100000:0.0:1788271660.470477:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788271660.470483:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:8456:x1875138586897664:12345-0@lo:502: 00000100:00100000:0.0:1788271660.470701:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:8456:x1875138586897664:12345-0@lo:502: Request processed in 217us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271660.470708:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271660.470829:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8456:1875138586897664:0@lo:502: 00000100:00100000:2.0:1788271660.470874:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8456:1875138586897792:0@lo:502: 00000100:00100000:2.0:1788271660.470903:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.470929:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.470977:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897792 00000100:00100000:3.0:1788271660.470981:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897792 00000100:00100000:3.0:1788271660.471008:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788271660.471014:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:8456:x1875138586897792:12345-0@lo:502: 00000100:00100000:3.0:1788271660.471162:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:8456:x1875138586897792:12345-0@lo:502: Request processed in 147us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.471168:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788271660.471248:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8456:1875138586897792:0@lo:502: 00000040:00080000:2.0:1788271660.471263:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788271660.471441:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788271660.471460:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271660.471472:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.471483:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271660.471493:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788271660.471496:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788271660.471499:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788271660.471527:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.471536:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.471545:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271660.471570:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897920:0@lo:101: 00000100:00100000:3.0:1788271660.471597:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.471635:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271660.471709:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586897920 00000100:00100000:1.0:1788271660.471714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586897920 00000100:00100000:1.0:1788271660.471749:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788271660.471768:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+13:5834:x1875138586897920:12345-0@lo:101: 00010000:00010000:1.0:1788271660.471777:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271660.471791:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f71d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f71ca expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271660.471815:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f71d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71ca expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271660.471826:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f71d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71ca expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271660.471836:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6a00, rc 0) 00000100:00100000:1.0:1788271660.471867:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586897920:12345-0@lo:101: Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271660.471873:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788271660.472016:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586897920:0@lo:101: 00010000:00010000:2.0:1788271660.472028:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271660.472037:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271660.472081:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898048:0@lo:501: 00000100:00100000:2.0:1788271660.472108:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.472129:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.472165:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898048 00000100:00100000:3.0:1788271660.472170:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898048 00000100:00100000:3.0:1788271660.472201:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788271660.472208:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586898048:12345-0@lo:501: 00000100:00100000:3.0:1788271660.472475:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586898048:12345-0@lo:501: Request processed in 268us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.472482:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788271660.472728:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898048:0@lo:501: 00000100:00100000:2.0:1788271660.472761:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898176:0@lo:503: 00000100:00100000:2.0:1788271660.472798:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.472827:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.472891:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898176 00000100:00100000:3.0:1788271660.472895:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898176 00000100:00100000:3.0:1788271660.472922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788271660.472929:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586898176:12345-0@lo:503: 00000100:00100000:3.0:1788271660.473090:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586898176:12345-0@lo:503: Request processed in 160us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.473096:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788271660.473176:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898176:0@lo:503: 00000100:00100000:1.0:1788271660.474006:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8457:1875138586898304:0@lo:502: 00000100:00100000:1.0:1788271660.474060:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271660.474095:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61cc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.474149:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898304 00000100:00100000:3.0:1788271660.474154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898304 00000100:00100000:3.0:1788271660.474190:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788271660.474199:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8457:x1875138586898304:12345-0@lo:502: 00000100:00100000:3.0:1788271660.474480:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8457:x1875138586898304:12345-0@lo:502: Request processed in 281us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.474488:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788271660.481266:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8457:1875138586898304:0@lo:502: 00000020:01000000:1.0:1788271660.481391:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271660.481485:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271660.481491:0:8457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788271660.481502:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788271660.481618:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8457:1875138586898432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271660.481892:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271660.481984:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.485118:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898432 00000100:00100000:2.0:1788271660.485138:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898432 00000100:00100000:2.0:1788271660.485265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788271660.485280:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8457:x1875138586898432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271660.485703:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:8457:x1875138586898432:12345-0@lo:502:llog_process_th.0 Request processed in 426us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.485713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788271660.487577:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8457:1875138586898432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271660.487655:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271660.487669:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271660.487672:0:8457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788271660.487678:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788271660.487988:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788271660.488010:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788271660.488033:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.488043:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271660.488054:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788271660.488056:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c914a800 from 39 10000000:01000000:3.0:1788271660.488060:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271660.488107:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.488114:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.488123:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271660.488145:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.488214:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.488256:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271660.490401:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898560 00000100:00100000:0.0:1788271660.490467:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898560 00000100:00100000:0.0:1788271660.490811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788271660.490826:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:5834:x1875138586898560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271660.490847:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271660.490871:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0030200/0xbeb05ca97b5f71df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f71d8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.490975:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0030200/0xbeb05ca97b5f71df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71d8 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.490991:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0030200/0xbeb05ca97b5f71df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71d8 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.491020:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0030200, rc 0) 00000100:00100000:0.0:1788271660.495210:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586898560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4374us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271660.495227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788271660.495569:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271660.495604:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.495619:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271660.495728:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.495794:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.495843:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271660.496953:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898688 00000100:00100000:1.0:1788271660.496966:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898688 00000100:00100000:1.0:1788271660.497019:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788271660.497029:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586898688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271660.497453:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586898688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271660.497461:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788271660.497582:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.497634:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.497687:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.497732:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271660.497788:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898816 00000100:00100000:1.0:1788271660.497793:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898816 00000100:00100000:1.0:1788271660.497826:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788271660.497834:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586898816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271660.497998:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586898816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271660.498005:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788271660.498875:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586898816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271660.499602:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8458:1875138586898944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271660.499674:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.499726:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.499782:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586898944 00000100:00100000:3.0:1788271660.499789:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586898944 00000100:00100000:3.0:1788271660.499829:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788271660.499839:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8458:x1875138586898944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271660.500147:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8458:x1875138586898944:12345-0@lo:502:llog_process_th.0 Request processed in 307us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.500156:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788271660.500315:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8458:1875138586898944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271660.500377:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8458:1875138586899072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271660.500451:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.500474:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.500527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899072 00000100:00100000:3.0:1788271660.500532:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899072 00000100:00100000:3.0:1788271660.500568:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788271660.500576:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8458:x1875138586899072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271660.500710:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:8458:x1875138586899072:12345-0@lo:502:llog_process_th.0 Request processed in 135us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.500718:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788271660.500863:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8458:1875138586899072:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788271660.500882:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788271660.501201:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788271660.501224:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271660.501236:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.501261:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271660.501273:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788271660.501276:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788271660.501279:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788271660.501312:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.501321:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.501332:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271660.501348:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.501393:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.501441:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.501667:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899200 00000100:00100000:2.0:1788271660.501673:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899200 00000100:00100000:3.0:1788271660.501769:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788271660.501778:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:5834:x1875138586899200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271660.501791:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271660.501806:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d2000/0xbeb05ca97b5f71ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f71e6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.501830:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d2000/0xbeb05ca97b5f71ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71e6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.501840:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d2000/0xbeb05ca97b5f71ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71e6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.501857:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d2000, rc 0) 00000100:00100000:3.0:1788271660.501912:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586899200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.501919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788271660.502156:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271660.502182:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.502193:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271660.502254:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.502286:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271660.502324:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.502330:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899328 00000100:00100000:2.0:1788271660.502335:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899328 00000100:00100000:2.0:1788271660.502377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788271660.502385:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586899328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271660.502869:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586899328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 484us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.502878:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788271660.503740:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.503786:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.503838:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271660.503874:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.503877:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899456 00000100:00100000:2.0:1788271660.503883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899456 00000100:00100000:2.0:1788271660.503992:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788271660.504003:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586899456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271660.504257:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586899456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.504266:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788271660.504337:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.509975:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8459:1875138586899584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271660.510114:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.510184:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.510202:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899584 00000100:00100000:2.0:1788271660.510211:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899584 00000100:00100000:2.0:1788271660.510277:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788271660.510290:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8459:x1875138586899584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271660.510642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8459:x1875138586899584:12345-0@lo:502:llog_process_th.0 Request processed in 353us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.510651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788271660.510674:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8459:1875138586899584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271660.510712:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271660.510725:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271660.510727:0:8459:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788271660.510733:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788271660.510757:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8459:1875138586899712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271660.510806:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271660.510842:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.511009:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899712 00000100:00100000:3.0:1788271660.511015:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899712 00000100:00100000:3.0:1788271660.511060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788271660.511069:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8459:x1875138586899712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271660.511218:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:8459:x1875138586899712:12345-0@lo:502:llog_process_th.0 Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.511226:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788271660.511579:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8459:1875138586899712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271660.511626:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271660.511631:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271660.511633:0:8459:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788271660.511638:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788271660.512470:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788271660.512498:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788271660.512512:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.512527:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271660.512541:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788271660.512544:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c9170000 from 39 10000000:01000000:3.0:1788271660.512569:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271660.512624:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.512634:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.512647:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271660.512671:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.512732:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.512780:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271660.513519:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899840 00000100:00100000:1.0:1788271660.513529:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899840 00000100:00100000:1.0:1788271660.513595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788271660.513606:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586899840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271660.513630:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271660.513646:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f71fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f71f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271660.513676:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f71fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71f4 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271660.513689:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f71fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f71f4 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271660.513700:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7200, rc 0) 00000100:00100000:1.0:1788271660.513756:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586899840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271660.513763:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788271660.514534:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271660.514658:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.514672:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271660.514761:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.514807:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.514846:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.514867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586899968 00000100:00100000:3.0:1788271660.514872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586899968 00000100:00100000:3.0:1788271660.514904:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788271660.514912:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586899968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.516942:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586899968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2018us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.516969:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788271660.517540:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586899968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.517841:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.517908:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271660.517985:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271660.518321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900096 00000100:00100000:1.0:1788271660.518330:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900096 00000100:00100000:1.0:1788271660.518492:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788271660.518506:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586900096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271660.519012:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586900096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 508us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271660.519028:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788271660.519128:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271660.519875:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8460:1875138586900224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271660.519940:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271660.519985:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.519990:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900224 00000100:00100000:2.0:1788271660.519997:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900224 00000100:00100000:2.0:1788271660.520039:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788271660.520047:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8460:x1875138586900224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271660.520264:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8460:x1875138586900224:12345-0@lo:502:llog_process_th.0 Request processed in 217us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.520273:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788271660.520289:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8460:1875138586900224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271660.520337:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8460:1875138586900352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271660.520389:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271660.520890:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fec1e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.524547:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900352 00000100:00100000:3.0:1788271660.524573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900352 00000100:00100000:3.0:1788271660.524670:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788271660.524683:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8460:x1875138586900352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271660.525908:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8460:x1875138586900352:12345-0@lo:502:llog_process_th.0 Request processed in 1221us (5512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.525921:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788271660.526448:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8460:1875138586900352:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788271660.526497:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788271660.526762:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788271660.526787:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788271660.526800:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.526810:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271660.526819:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788271660.526821:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788271660.526823:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788271660.526860:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.526866:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.526874:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271660.526893:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.526944:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271660.526989:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900480 00000100:00100000:0.0:1788271660.526993:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.526996:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900480 00000100:00100000:2.0:1788271660.527047:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788271660.527068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586900480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271660.527085:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271660.527102:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f7209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271660.527129:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f7209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7202 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271660.527155:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f7209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7202 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271660.527165:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b200, rc 0) 00000100:00100000:2.0:1788271660.527208:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586900480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.527215:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788271660.527348:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271660.527372:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.527382:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271660.527484:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.527507:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271660.527535:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.527583:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900608 00000100:00100000:2.0:1788271660.527587:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900608 00000100:00100000:2.0:1788271660.527660:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788271660.527668:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586900608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271660.527964:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586900608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.527972:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788271660.528036:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.528069:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.528112:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.528140:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.528141:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900736 00000100:00100000:2.0:1788271660.528145:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900736 00000100:00100000:2.0:1788271660.528206:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788271660.528214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586900736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271660.528395:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586900736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.528403:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788271660.528503:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586900736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.529296:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8461:1875138586900864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271660.529349:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.529454:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271660.529634:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900864 00000100:00100000:0.0:1788271660.529641:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900864 00000100:00100000:0.0:1788271660.529713:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788271660.529724:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8461:x1875138586900864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271660.530001:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8461:x1875138586900864:12345-0@lo:502:llog_process_th.0 Request processed in 278us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271660.530010:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788271660.530099:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8461:1875138586900864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271660.530129:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271660.530141:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271660.530144:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788271660.530151:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788271660.530175:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8461:1875138586900992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271660.530211:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271660.530452:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271660.530602:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586900992 00000100:00100000:2.0:1788271660.530608:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586900992 00000100:00100000:2.0:1788271660.530633:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788271660.530642:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8461:x1875138586900992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271660.530846:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8461:x1875138586900992:12345-0@lo:502:llog_process_th.0 Request processed in 204us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271660.530861:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788271660.531000:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8461:1875138586900992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271660.531023:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271660.531029:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271660.531031:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788271660.531035:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788271660.531723:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788271660.531746:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788271660.531758:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.531770:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271660.531781:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788271660.531784:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab6e59d0000 from 1 10000000:01000000:0.0:1788271660.531787:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788271660.531824:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.531833:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.531859:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271660.531882:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586901120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.532125:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271660.532171:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.532279:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586901120 00000100:00100000:3.0:1788271660.532286:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586901120 00000100:00100000:3.0:1788271660.532336:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788271660.532346:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586901120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271660.532370:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271660.532387:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f7217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.532434:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f7217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7210 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.532447:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f7217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7210 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271660.532457:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7021d2400, rc 0) 00000100:00100000:3.0:1788271660.532493:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586901120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271660.532500:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788271660.532669:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586901120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271660.532688:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.532698:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271660.532755:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586901248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271660.532784:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271660.532814:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271660.532859:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586901248 00000100:00100000:3.0:1788271660.532864:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586901248 00000100:00100000:3.0:1788271660.532889:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788271660.532896:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586901248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271660.533308:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586901248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (521us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271660.533323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788271660.533460:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586901248:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788271660.533485:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788271660.533491:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271660.533500:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271661.043301:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271661.045532:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271661.045574:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586901376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271661.045687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271661.045893:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586901376 00000100:00100000:0.0:1788271661.045923:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586901376 00000100:00100000:0.0:1788271661.046017:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271661.046030:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586901376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271661.046082:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271661.046147:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586901376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271661.046155:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788271661.046228:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff348e00 x1875138586901376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271661.046252:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586901376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271661.047799:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586901504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271661.047888:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271661.048232:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586901504 00000100:00100000:1.0:1788271661.048244:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586901504 00000100:00100000:1.0:1788271661.048312:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788271661.048325:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586901504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271661.048380:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271661.048478:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586901504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271661.048486:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788271661.048532:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0c2680 x1875138586901504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271661.048551:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586901504:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788271661.050548:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271661.050560:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271661.052736:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586901888:0@lo:400:kworker.0 00000100:00100000:1.0:1788271661.052831:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271661.052906:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271661.052913:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586902016:0@lo:400:kworker.0 00000100:00100000:1.0:1788271661.052939:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271661.053112:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586901760:0@lo:400:kworker.0 00000100:00100000:3.0:1788271661.053147:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271661.053180:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271661.053186:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586901632:0@lo:400:kworker.0 00000100:00100000:3.0:1788271661.053219:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271661.053331:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586901888 00000100:00100000:2.0:1788271661.053341:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586901888 00000100:00100000:2.0:1788271661.053457:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902016 00000100:00100000:2.0:1788271661.053461:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902016 00000100:00100000:2.0:1788271661.053477:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586901760 00000100:00100000:2.0:1788271661.053479:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586901760 00000100:00100000:2.0:1788271661.053495:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788271661.053506:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586901888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271661.053574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586901888:12345-0@lo:400:kworker.0 Request processed in 68us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271661.053582:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788271661.053606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271661.053613:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586902016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271661.053641:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586902016:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271661.053648:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271661.053660:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271661.053667:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586901760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271661.053711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586901760:12345-0@lo:400:kworker.0 Request processed in 44us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271661.053717:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788271661.053844:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271661.053883:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586901760:0@lo:400:kworker.0 00000100:00100000:0.0:1788271661.055007:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586901632 00000100:00100000:0.0:1788271661.055018:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586901632 00000100:00100000:0.0:1788271661.055093:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788271661.055104:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586901632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271661.055204:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586901632:12345-0@lo:400:kworker.0 Request processed in 102us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271661.055211:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788271661.056750:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586901632:0@lo:400:kworker.0 00000100:00100000:1.0:1788271661.056986:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586902016:0@lo:400:kworker.0 00000100:00100000:1.0:1788271661.057006:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586901888:0@lo:400:kworker.0 00000100:00100000:0.0:1788271661.163938:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271661.163993:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271661.164040:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271661.164078:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271661.164123:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291328 00000100:00100000:0.0:1788271661.164135:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291328 00000100:00100000:0.0:1788271661.164204:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291456 00000100:00100000:0.0:1788271661.164226:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291456 00000100:00100000:0.0:1788271661.164270:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:0.0:1788271661.164282:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574291328:12345-192.168.201.1@tcp:400: 00000100:00100000:0.0:1788271661.164386:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574291328:12345-192.168.201.1@tcp:400: Request processed in 106us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271661.164518:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788271661.164531:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788271661.164551:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788271661.164561:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271661.164569:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574291456:12345-192.168.201.1@tcp:400: 00000100:00100000:1.0:1788271661.164601:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574291456:12345-192.168.201.1@tcp:400: Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271661.164609:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1788271661.165686:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291200 00000100:00100000:2.0:1788271661.165702:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291200 00000100:00100000:2.0:1788271661.165768:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1788271661.165788:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574291200:12345-192.168.201.1@tcp:400: 00000100:00100000:2.0:1788271661.165856:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574291200:12345-192.168.201.1@tcp:400: Request processed in 71us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271661.165864:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:0.0:1788271661.166868:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:3.0:1788271661.167232:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291072 00000100:00100000:3.0:1788271661.167242:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291072 00000100:00100000:3.0:1788271661.167301:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00100000:3.0:1788271661.167312:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+8:2353:x1875138574291072:12345-192.168.201.1@tcp:400: 00000100:00100000:3.0:1788271661.167438:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+8:2353:x1875138574291072:12345-192.168.201.1@tcp:400: Request processed in 104us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271661.167447:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00080000:3.0:1788271661.167497:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271661.167503:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271661.167507:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788271662.070394:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271663.090854:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271664.114747:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271665.139200:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271665.770608:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271665.770798:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291584 00000100:00100000:3.0:1788271665.770807:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291584 00000100:00100000:3.0:1788271665.770867:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:3.0:1788271665.770876:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+8:5596:x1875138574291584:12345-192.168.201.1@tcp:101: 00010000:00010000:3.0:1788271665.770901:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271665.770927:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18200/0xbeb05ca97b5f721e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x76932646102379c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271665.770954:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18200/0xbeb05ca97b5f721e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102379c expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271665.770966:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee18200/0xbeb05ca97b5f721e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102379c expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271665.770977:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18200, rc 0) 00000100:00100000:3.0:1788271665.771029:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5596:x1875138574291584:12345-192.168.201.1@tcp:101: Request processed in 154us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271665.771034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:2.0:1788271665.774191:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271665.781584:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291712 00000100:00100000:0.0:1788271665.781601:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291712 00000100:00100000:0.0:1788271665.781684:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 165 00000100:00100000:0.0:1788271665.781696:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5596:x1875138574291712:12345-192.168.201.1@tcp:501: 00000100:00100000:0.0:1788271665.781975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5596:x1875138574291712:12345-192.168.201.1@tcp:501: Request processed in 280us (7792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271665.781983:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 165 00000100:00100000:2.0:1788271665.786789:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271665.786941:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291840 00000100:00100000:0.0:1788271665.786951:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291840 00000100:00100000:0.0:1788271665.787011:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 166 00000100:00100000:0.0:1788271665.787023:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5596:x1875138574291840:12345-192.168.201.1@tcp:503: 00000100:00100000:0.0:1788271665.788071:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5596:x1875138574291840:12345-192.168.201.1@tcp:503: Request processed in 1046us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271665.788086:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 166 00000100:00100000:1.0:1788271665.792548:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271665.792641:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574291968 00000100:00100000:3.0:1788271665.792650:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574291968 00000100:00100000:3.0:1788271665.792712:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 167 00000100:00100000:3.0:1788271665.792722:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+9:6098:x1875138574291968:12345-192.168.201.1@tcp:502: 00000100:00100000:3.0:1788271665.793060:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+9:6098:x1875138574291968:12345-192.168.201.1@tcp:502: Request processed in 338us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271665.793068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 167 00000100:00100000:2.0:1788271665.796566:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271665.796743:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292096 00000100:00100000:0.0:1788271665.796754:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292096 00000100:00100000:0.0:1788271665.796852:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:0.0:1788271665.796864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+9:6098:x1875138574292096:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271665.797181:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+9:6098:x1875138574292096:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 319us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271665.797190:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:2.0:1788271665.800209:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271665.800719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292224 00000100:00100000:3.0:1788271665.800728:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292224 00000100:00100000:3.0:1788271665.800784:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00100000:3.0:1788271665.800794:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5596:x1875138574292224:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271665.800809:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271665.800833:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f7225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7693264610237a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271665.800878:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237a3 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271665.800889:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237a3 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271665.800899:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18a00, rc 0) 00000100:00100000:3.0:1788271665.801044:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574292224:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 251us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271665.801052:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00100000:1.0:1788271665.803106:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271665.803197:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292352 00000100:00100000:2.0:1788271665.803205:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292352 00000100:00100000:2.0:1788271665.803252:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 170 00000100:00100000:2.0:1788271665.803259:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574292352:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271665.803571:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574292352:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 311us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271665.803578:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 170 00000100:00100000:2.0:1788271666.162674:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586902144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271666.162751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271666.162824:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586902656:0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.162853:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271666.162867:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586902400:0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.162876:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788271666.162885:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586902272:0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.162915:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271666.162934:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586902784:0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.162978:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271666.163023:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902144 00000100:00100000:2.0:1788271666.163032:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902144 00000100:00100000:2.0:1788271666.163157:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271666.163167:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586902144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271666.163201:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271666.163246:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586902144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271666.163253:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271666.163311:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586902528:0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.163337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788271666.163383:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34a680 x1875138586902144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271666.163400:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586902144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271666.163448:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902656 00000100:00100000:2.0:1788271666.163452:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902656 00000100:00100000:2.0:1788271666.163477:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271666.163483:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586902656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.163520:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586902656:12345-0@lo:400:kworker.0 Request processed in 38us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271666.163527:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788271666.163543:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788271666.163560:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0c0380 x1875138586902656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271666.163570:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586902656:0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.163606:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902784 00000100:00100000:2.0:1788271666.163610:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902784 00000100:00100000:2.0:1788271666.163635:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902528 00000100:00100000:2.0:1788271666.163637:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902528 00000100:00100000:2.0:1788271666.163655:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788271666.163660:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586902784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.163695:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586902784:12345-0@lo:400:kworker.0 Request processed in 34us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271666.163701:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788271666.163713:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788271666.163718:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586902528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.163749:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586902528:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271666.163755:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788271666.163783:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586902528:0@lo:400:kworker.0 00000100:00100000:2.0:1788271666.163804:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586902784:0@lo:400:kworker.0 00000100:00080000:3.0:1788271666.163901:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271666.163906:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271666.164009:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271666.164031:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586902912:0@lo:400:kworker.0 00000100:00100000:1.0:1788271666.164050:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271666.164480:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902400 00000100:00100000:0.0:1788271666.164483:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902400 00000100:00100000:0.0:1788271666.164506:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788271666.164511:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586902400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271666.164541:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586902400:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271666.164545:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788271666.164573:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902272 00000100:00100000:0.0:1788271666.164575:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902272 00000100:00100000:0.0:1788271666.164589:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788271666.164593:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586902272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271666.164614:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586902272:12345-0@lo:400:kworker.0 Request processed in 21us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271666.164618:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788271666.164644:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586902272:0@lo:400:kworker.0 00000100:00100000:3.0:1788271666.164704:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586902912 00000100:00100000:3.0:1788271666.164707:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586902912 00000100:00100000:3.0:1788271666.164736:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271666.164741:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586902912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271666.164766:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586902912:12345-0@lo:400:kworker.0 Request processed in 26us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271666.164769:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788271666.166224:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271666.166916:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586903040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271666.166996:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271666.167082:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586902400:0@lo:400:kworker.0 00010000:00080000:1.0:1788271666.167096:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0c3b80 x1875138586902912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271666.167127:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586902912:0@lo:400:kworker.0 00000100:00100000:3.0:1788271666.168744:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586903040 00000100:00100000:3.0:1788271666.168756:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586903040 00000100:00100000:3.0:1788271666.168837:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271666.168849:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586903040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271666.168886:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271666.168986:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586903040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271666.169008:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788271666.169919:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34b800 x1875138586903040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271666.169944:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586903040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271666.291194:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271666.291250:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271666.291313:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271666.291402:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271666.291520:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292608 00000100:00100000:0.0:1788271666.291530:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292608 00000100:00100000:0.0:1788271666.291597:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:0.0:1788271666.291608:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574292608:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271666.291680:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574292608:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 74us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271666.291700:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00080000:0.0:1788271666.291730:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271666.291936:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292736 00000100:00100000:2.0:1788271666.291942:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292736 00000100:00100000:3.0:1788271666.291948:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292480 00000100:00100000:3.0:1788271666.291955:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292480 00000100:00100000:2.0:1788271666.292000:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292864 00000100:00100000:2.0:1788271666.292004:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292864 00000100:00100000:2.0:1788271666.292029:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1788271666.292047:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574292736:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271666.292085:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574292736:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 49us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271666.292092:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1788271666.292106:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:2.0:1788271666.292119:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574292864:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271666.292143:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574292864:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271666.292150:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271666.292269:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 172 00000100:00100000:3.0:1788271666.292279:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2353:x1875138574292480:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271666.292309:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2353:x1875138574292480:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 33us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271666.292316:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 172 00000100:00080000:1.0:1788271666.292458:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271666.292464:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788271667.189676:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788271667.282260:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1f36c440 20000000:00000080:2.0:1788271667.282276:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab6caa81c00 uarg=0000000000000000 20000000:01000000:2.0:1788271667.282311:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788271667.282317:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788271667.282321:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788271667.284013:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788271667.284313:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788271667.293023:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788271667.293219:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788271667.293290:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788271667.293308:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788271667.293327:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293344:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c148a400/0xbeb05ca97b5f6fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293353:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293360:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293369:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293378:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293530:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293546:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 9 pid: 5830 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271667.293578:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903168:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271667.293798:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293808:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271667.293817:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903296:0@lo:104: 00000100:00100000:0.0:1788271667.293854:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271667.293894:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293903:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 18 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271667.293911:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903424:0@lo:104: 00000100:00100000:3.0:1788271667.293924:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586903296 00000100:00100000:3.0:1788271667.293931:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586903296 00000100:00100000:0.0:1788271667.293934:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271667.293972:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788271667.293972:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c148a400/0xbeb05ca97b5f6fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.293980:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6c148a400/0xbeb05ca97b5f6fa1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271667.293982:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586903424 00000100:00100000:3.0:1788271667.293984:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586903424 00000100:00100000:0.0:1788271667.293988:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903552:0@lo:104: 00000100:00100000:3.0:1788271667.294000:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271667.294008:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271667.294009:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:8503:x1875138586903296:12345-0@lo:104: 00000100:00100000:0.0:1788271667.294018:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3ca80 going to sleep for 11 seconds 00010000:00010000:3.0:1788271667.294021:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294083:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271667.294090:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:8503:x1875138586903296:12345-0@lo:104: Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271667.294096:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788271667.294099:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788271667.294107:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788271667.294118:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586903552 00000100:00100000:3.0:1788271667.294121:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586903552 00000100:00100000:3.0:1788271667.294136:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271667.294141:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:8503:x1875138586903424:12345-0@lo:104: 00010000:00010000:3.0:1788271667.294149:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294189:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788271667.294195:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:8503:x1875138586903424:12345-0@lo:104: Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271667.294201:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271667.294232:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271667.294250:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:8503:x1875138586903552:12345-0@lo:104: 00010000:00010000:3.0:1788271667.294257:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294284:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788271667.294289:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:8503:x1875138586903552:12345-0@lo:104: Request processed in 51us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271667.294294:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788271667.294310:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1788271667.294311:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903296:0@lo:104: 00010000:00010000:3.0:1788271667.294315:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271667.294319:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903424:0@lo:104: 00010000:00010000:3.0:1788271667.294322:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148a800 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271667.294326:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271667.294333:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903552:0@lo:104: 00010000:00010000:3.0:1788271667.294335:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271667.294343:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271667.294349:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788271667.294387:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294393:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271667.294438:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294445:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148a800/0xbeb05ca97b5f70c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f70ce expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294459:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271667.294462:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294467:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d2600 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271667.294470:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294476:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271667.294481:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271667.294486:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788271667.294498:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294503:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271667.294510:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294526:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2600/0xbeb05ca97b5f6ffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7003 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294537:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271667.294540:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294546:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd400 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271667.294550:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294556:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271667.294563:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271667.294568:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788271667.294601:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294608:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271667.294630:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294637:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c13fd400/0xbeb05ca97b5f6f9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f6fa1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271667.294648:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271667.294655:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271667.294656:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271667.294670:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586903680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271667.294693:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271667.294699:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271667.294702:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586903936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271667.294737:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271667.294743:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586903808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271667.294889:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271667.294957:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586903680 00000100:00100000:1.0:1788271667.294962:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586903680 00010000:00010000:1.0:1788271667.294983:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 19 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271667.295010:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586903936 00000100:00100000:1.0:1788271667.295013:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586903936 00010000:00010000:1.0:1788271667.295024:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c148a400/0xbeb05ca97b5f6fa1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 20 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271667.295035:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788271667.295041:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3280:x1875138586903680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271667.295051:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788271667.295155:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788271667.295162:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788271667.295331:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 20 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.295347:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 20 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.295360:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3800/0xbeb05ca97b5f70ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f70c7 expref: 20 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.295371:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271667.295399:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586903680:12345-0@lo:103:ldlm_bl.0 Request processed in 359us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271667.295406:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788271667.295443:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271667.295450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:3279:x1875138586903936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271667.295457:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271667.295462:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c148a400/0xbeb05ca97b5f6fa1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.295470:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c148a400/0xbeb05ca97b5f6fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.295479:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c148a400/0xbeb05ca97b5f6fa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6f9a expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.295487:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271667.295521:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3279:x1875138586903936:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271667.295527:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788271667.295590:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586903936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271667.295751:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271667.296709:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271667.297848:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586903680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271667.298318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586903808 00000100:00100000:1.0:1788271667.298325:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586903808 00010000:00010000:1.0:1788271667.298375:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 17 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271667.298438:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271667.298447:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3280:x1875138586903808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271667.298460:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271667.298465:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 17 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.298476:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 17 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.298494:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2800/0xbeb05ca97b5f7003 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f6ffc expref: 17 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.298509:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271667.298569:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3280:x1875138586903808:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271667.298576:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271667.298667:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586903808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271667.308768:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271667.308917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574292992 00000100:00100000:1.0:1788271667.308926:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574292992 00010000:00010000:1.0:1788271667.308965:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 10 pid: 5830 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271667.309048:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:1.0:1788271667.309058:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2353:x1875138574292992:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271667.309074:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271667.309080:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 10 pid: 5830 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.309110:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 10 pid: 5830 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271667.309113:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875138586903168:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271667.309127:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f718b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x76932646102376b expref: 10 pid: 5830 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.309143:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.309213:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310295:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310308:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310316:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310324:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310331:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0030a00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271667.310336:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310344:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310373:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271667.310385:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271667.310484:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+9:2353:x1875138574292992:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1424us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271667.310493:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00010000:00010000:2.0:1788271667.310572:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271667.310582:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271667.310588:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271667.310595:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f722c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271667.678897:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271667.678978:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574293120 00000100:00100000:0.0:1788271667.678987:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574293120 00000100:00100000:0.0:1788271667.679048:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:0.0:1788271667.679059:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+9:5596:x1875138574293120:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271667.679077:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271667.679100:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7693264610237aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.679139:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.679150:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271667.679160:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0031600, rc 0) 00000100:00100000:0.0:1788271667.679245:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574293120:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 186us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271667.679252:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:3.0:1788271667.695265:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271667.695386:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574293248 00000100:00100000:1.0:1788271667.695399:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574293248 00000100:00100000:1.0:1788271667.695501:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:1.0:1788271667.695520:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574293248:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271667.696003:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574293248:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 490us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271667.696013:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:1.0:1788271667.701132:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271667.702991:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574293376 00000100:00100000:3.0:1788271667.703007:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574293376 00000100:00100000:3.0:1788271667.703077:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:3.0:1788271667.703086:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574293376:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271667.703337:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:5596:x1875138574293376:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 250us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271667.703345:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:2.0:1788271667.707941:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271667.708068:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574293504 00000100:00100000:0.0:1788271667.708079:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574293504 00000100:00100000:0.0:1788271667.708138:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:0.0:1788271667.708149:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:6144:x1875138574293504:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271667.708476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:6144:x1875138574293504:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 327us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271667.708485:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:2.0:1788271667.731369:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271667.731760:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574293632 00000100:00100000:1.0:1788271667.731770:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574293632 00000100:00100000:1.0:1788271667.731828:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 177 00000100:00100000:1.0:1788271667.731838:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:6144:x1875138574293632:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271667.732095:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:6144:x1875138574293632:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 258us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271667.732104:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 177 00010000:00010000:3.0:1788271668.217385:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788271669.174631:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788271669.174638:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6ee935800 from 4 10000000:01000000:2.0:1788271669.174643:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271669.174687:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271669.174699:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271669.174711:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271669.174734:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271669.174793:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.174889:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f78200c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.174936:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904064 00000100:00100000:3.0:1788271669.174944:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904064 00000100:00100000:3.0:1788271669.174985:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788271669.174994:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586904064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271669.175005:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271669.175018:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f723a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.175054:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.175065:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.175074:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19200, rc 0) 00000100:00100000:3.0:1788271669.175116:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586904064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.175122:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788271669.182390:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271669.182431:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271669.182444:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271669.182525:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271669.182578:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.182707:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904192 00000100:00100000:3.0:1788271669.182714:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904192 00000100:00100000:3.0:1788271669.182755:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788271669.182765:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586904192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.182997:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586904192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.183004:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788271669.183594:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f78200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271669.183614:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271669.183649:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271669.183691:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.183790:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f78200c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.184148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904320 00000100:00100000:3.0:1788271669.184154:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904320 00000100:00100000:3.0:1788271669.184188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788271669.184195:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586904320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.184371:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586904320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.184378:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788271669.184496:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271669.190685:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8586:1875138586904448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271669.190774:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271669.190858:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271669.200045:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904448 00000100:00100000:2.0:1788271669.200073:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904448 00000100:00100000:2.0:1788271669.200185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788271669.200196:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8586:x1875138586904448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271669.200494:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8586:x1875138586904448:12345-0@lo:502:llog_process_th.0 Request processed in 299us (9719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271669.200502:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788271669.200623:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8586:1875138586904448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271669.200659:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271669.200669:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271669.200671:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788271669.200677:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6ee935800 00000020:00000080:1.0:1788271669.200680:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788271669.200765:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8586:1875138586904576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271669.200804:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271669.200839:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271669.201478:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904576 00000100:00100000:1.0:1788271669.201484:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904576 00000100:00100000:1.0:1788271669.201513:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788271669.201521:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8586:x1875138586904576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271669.201667:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:8586:x1875138586904576:12345-0@lo:502:llog_process_th.0 Request processed in 146us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.201674:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788271669.201712:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8586:1875138586904576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271669.201730:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271669.201734:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271669.201736:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788271669.201740:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788271669.203610:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788271669.203639:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271669.203655:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.203667:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271669.203677:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788271669.203680:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c914a800 from 4 10000000:01000000:3.0:1788271669.203682:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271669.203714:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.203721:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.203732:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271669.203754:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.203810:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.203844:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.203883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904704 00000100:00100000:3.0:1788271669.203888:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904704 00000100:00100000:3.0:1788271669.203927:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788271669.203935:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586904704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271669.203947:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271669.203959:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7248 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.203978:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.203993:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.204001:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18000, rc 0) 00000100:00100000:3.0:1788271669.204035:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586904704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.204041:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788271669.204085:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271669.204097:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.204105:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271669.204143:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.204164:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.204175:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.204185:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904832 00000100:00100000:3.0:1788271669.204188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904832 00000100:00100000:3.0:1788271669.204218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788271669.204224:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586904832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.204451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586904832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.204458:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788271669.204487:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.204521:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.204556:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.204568:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.204579:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586904960 00000100:00100000:3.0:1788271669.204582:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586904960 00000100:00100000:3.0:1788271669.204600:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788271669.204606:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586904960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.204732:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586904960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.204738:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788271669.204775:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586904960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.204916:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8589:1875138586905088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.204943:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.204959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905088 00000100:00100000:3.0:1788271669.204962:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905088 00000100:00100000:3.0:1788271669.204978:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788271669.204984:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8589:x1875138586905088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.205090:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8589:x1875138586905088:12345-0@lo:502:llog_process_th.0 Request processed in 105us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.205097:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788271669.205122:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.205134:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8589:1875138586905088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271669.205152:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271669.205162:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271669.205168:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788271669.205175:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c914a800 00000020:00000080:3.0:1788271669.205178:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788271669.205253:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8589:1875138586905216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.205282:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.205299:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905216 00000100:00100000:3.0:1788271669.205302:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905216 00000100:00100000:3.0:1788271669.205322:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788271669.205328:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8589:x1875138586905216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.205441:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:8589:x1875138586905216:12345-0@lo:502:llog_process_th.0 Request processed in 112us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.205447:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788271669.205474:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.205485:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8589:1875138586905216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271669.205501:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271669.205504:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271669.205506:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788271669.205509:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788271669.205547:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788271669.205560:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271669.205566:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.205575:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271669.205584:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788271669.205586:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c9170000 from 4 10000000:01000000:3.0:1788271669.205589:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271669.205612:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.205620:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.205628:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271669.205640:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586905344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.205663:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.205675:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.205686:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905344 00000100:00100000:3.0:1788271669.205689:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905344 00000100:00100000:3.0:1788271669.205708:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788271669.205715:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586905344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271669.205722:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271669.205731:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7256 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.205747:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.205757:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.205764:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19400, rc 0) 00000100:00100000:3.0:1788271669.205789:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586905344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.205795:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788271669.205832:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586905344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271669.205843:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.205851:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271669.205884:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586905472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.205907:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.205919:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.205929:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905472 00000100:00100000:3.0:1788271669.205931:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905472 00000100:00100000:3.0:1788271669.205948:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788271669.205953:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586905472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.206097:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586905472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.206104:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788271669.206133:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586905472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.206153:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586905600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.206183:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.206195:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.214268:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905600 00000100:00100000:3.0:1788271669.214281:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905600 00000100:00100000:3.0:1788271669.214332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788271669.214342:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586905600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.214569:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586905600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (8384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.214582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788271669.214645:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586905600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271669.214845:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8592:1875138586905728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.214884:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.214904:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905728 00000100:00100000:3.0:1788271669.214907:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905728 00000100:00100000:3.0:1788271669.214925:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788271669.214931:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:8592:x1875138586905728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.215038:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:8592:x1875138586905728:12345-0@lo:502:llog_process_th.0 Request processed in 106us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.215044:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788271669.215081:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6cb558180 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.215093:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8592:1875138586905728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271669.215111:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271669.215120:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271669.215122:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788271669.215129:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c9170000 00000020:00000080:3.0:1788271669.215131:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788271669.215513:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8592:1875138586905856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.215544:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.215562:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905856 00000100:00100000:3.0:1788271669.215565:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905856 00000100:00100000:3.0:1788271669.215583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788271669.215589:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:8592:x1875138586905856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271669.215684:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:8592:x1875138586905856:12345-0@lo:502:llog_process_th.0 Request processed in 94us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.215695:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788271669.215719:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f7e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271669.215729:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:8592:1875138586905856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271669.215744:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271669.215748:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271669.215750:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788271669.215753:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788271669.215790:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788271669.215805:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271669.215814:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271669.215825:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271669.244334:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271670.262260:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271671.283438:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271671.284593:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586905984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271671.284666:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271671.284742:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586905984 00000100:00100000:2.0:1788271671.284749:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586905984 00000100:00100000:2.0:1788271671.284803:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271671.284813:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586905984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271671.284851:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271671.284895:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586905984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271671.284902:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788271671.284924:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788271671.284951:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee3b2300 x1875138586905984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271671.284969:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586905984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271671.285290:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586906112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271671.285316:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271671.285341:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586906624:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285363:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271671.285394:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788271671.285400:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586906240:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285450:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271671.285471:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586906752:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285492:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271671.285520:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586906624 00000100:00100000:2.0:1788271671.285525:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586906624 00000100:00100000:2.0:1788271671.285556:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271671.285564:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586906624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285601:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586906624:12345-0@lo:400:kworker.0 Request processed in 38us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271671.285607:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271671.285626:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586906240 00000100:00100000:2.0:1788271671.285629:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586906240 00000100:00100000:2.0:1788271671.285651:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788271671.285657:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586906240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285683:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586906240:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271671.285689:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788271671.285711:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586906752 00000100:00100000:2.0:1788271671.285714:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586906752 00000100:00100000:2.0:1788271671.285737:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271671.285742:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586906752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285768:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586906752:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271671.285773:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271671.285798:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586906368:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285828:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271671.285849:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271671.285854:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586906496:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285874:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271671.285895:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586906368 00000100:00100000:2.0:1788271671.285898:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586906368 00000100:00100000:2.0:1788271671.285915:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586906496 00000100:00100000:2.0:1788271671.285917:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586906496 00000100:00100000:2.0:1788271671.285930:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271671.285935:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586906368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.285963:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586906368:12345-0@lo:400:kworker.0 Request processed in 28us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271671.285968:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271671.285978:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271671.285984:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586906496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.286010:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586906496:12345-0@lo:400:kworker.0 Request processed in 26us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271671.286016:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788271671.286035:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271671.286128:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586906112 00000100:00100000:0.0:1788271671.286133:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586906112 00000100:00100000:0.0:1788271671.286158:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788271671.286165:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586906112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271671.286198:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271671.286230:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586906112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271671.286236:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788271671.286284:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271671.286310:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586906496:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.286319:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586906368:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.286350:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586906240:0@lo:400:kworker.0 00000100:00100000:2.0:1788271671.286360:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586906752:0@lo:400:kworker.0 00010000:00080000:2.0:1788271671.286370:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e5500 x1875138586906112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271671.286391:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586906112:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788271671.286403:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e4700 x1875138586906624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271671.286474:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586906624:0@lo:400:kworker.0 00000100:00100000:1.0:1788271671.413522:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271671.413627:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271671.413671:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271671.413709:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271671.413846:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574293888 00000100:00100000:1.0:1788271671.413855:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574293888 00000100:00100000:1.0:1788271671.413912:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1788271671.413921:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574293888:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271671.413988:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574293888:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 68us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271671.413994:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1788271671.414087:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294016 00000100:00100000:1.0:1788271671.414092:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294016 00000100:00100000:1.0:1788271671.414116:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294144 00000100:00100000:1.0:1788271671.414119:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294144 00000100:00100000:1.0:1788271671.414141:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1788271671.414148:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574294016:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271671.414185:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574294016:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 38us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271671.414192:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1788271671.414203:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1788271671.414209:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574294144:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271671.414231:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574294144:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271671.414237:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00080000:1.0:1788271671.414251:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271671.414255:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271671.414257:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271671.416181:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574293760 00000100:00100000:2.0:1788271671.416195:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574293760 00000100:00100000:2.0:1788271671.416256:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 194 00000100:00100000:2.0:1788271671.416267:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574293760:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271671.416331:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574293760:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 66us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271671.416339:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 194 00010000:00010000:3.0:1788271672.306764:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788271673.124505:0:8805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788271673.335561:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271674.354898:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271675.378600:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271676.402811:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586906880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271676.402886:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271676.403011:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586906880 00000100:00100000:0.0:1788271676.403019:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586906880 00000100:00100000:0.0:1788271676.403099:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788271676.403110:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586906880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271676.403146:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271676.403193:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586906880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271676.403201:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788271676.403251:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e4000 x1875138586906880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271676.403269:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586906880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788271676.407228:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271676.407342:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586907008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271676.407444:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271676.407514:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907008 00000100:00100000:0.0:1788271676.407522:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907008 00000100:00100000:0.0:1788271676.407570:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271676.407581:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586907008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271676.407616:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271676.407664:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586907008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271676.407672:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788271676.407721:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34dc00 x1875138586907008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271676.407741:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586907008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271676.407946:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586907264:0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.407979:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271676.408001:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271676.408007:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586907136:0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408036:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271676.408069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907264 00000100:00100000:2.0:1788271676.408073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907264 00000100:00100000:2.0:1788271676.408114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271676.408121:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586907264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408157:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586907264:12345-0@lo:400:kworker.0 Request processed in 37us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271676.408173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271676.408195:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907136 00000100:00100000:2.0:1788271676.408199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907136 00000100:00100000:2.0:1788271676.408223:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788271676.408230:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586907136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408261:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586907136:12345-0@lo:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271676.408267:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1788271676.408295:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271676.408312:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586907136:0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408322:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586907264:0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408340:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586907520:0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271676.408381:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271676.408387:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586907392:0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408406:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271676.408464:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907520 00000100:00100000:2.0:1788271676.408468:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907520 00000100:00100000:2.0:1788271676.408496:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907392 00000100:00100000:2.0:1788271676.408498:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907392 00000100:00100000:2.0:1788271676.408514:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271676.408519:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586907520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408551:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586907520:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271676.408557:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271676.408577:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788271676.408583:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586907392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408610:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586907392:12345-0@lo:400:kworker.0 Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271676.408614:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788271676.408633:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271676.408651:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586907392:0@lo:400:kworker.0 00000100:00100000:2.0:1788271676.408660:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586907520:0@lo:400:kworker.0 00010000:00010000:2.0:1788271676.409637:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271676.550277:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271676.550327:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271676.550367:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271676.550396:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271676.550454:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294528 00000100:00100000:1.0:1788271676.550462:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294528 00000100:00100000:1.0:1788271676.550514:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294656 00000100:00100000:1.0:1788271676.550517:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294656 00000100:00100000:1.0:1788271676.550539:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1788271676.550548:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2350:x1875138574294528:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:1.0:1788271676.550580:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7199 00000100:00080000:1.0:1788271676.550588:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3075800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271676.550624:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788271676.550849:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294400 00000100:00100000:0.0:1788271676.550854:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294400 00000100:00100000:0.0:1788271676.550888:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:0.0:1788271676.550895:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574294400:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271676.550982:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294272 00000100:00100000:2.0:1788271676.550987:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294272 00000100:00100000:2.0:1788271676.551015:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00100000:2.0:1788271676.551022:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574294272:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271676.551088:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+2:2350:x1875138574294528:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 540us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271676.551096:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1788271676.551112:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1788271676.551119:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2350:x1875138574294656:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:1.0:1788271676.551133:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f71a0 00000100:00080000:1.0:1788271676.551138:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3076800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271676.551159:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788271676.559935:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574294400:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 9027us (9594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271676.559950:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00010000:00010000:0.0:1788271676.560207:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271676.560235:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271676.560241:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271676.560245:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788271676.561146:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271676.564386:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574294272:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 13349us (14104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271676.564402:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00100000:1.0:1788271676.565768:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+2:2350:x1875138574294656:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 14641us (15362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271676.565781:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00010000:00010000:0.0:1788271677.426745:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271677.523316:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:3.0:1788271677.523325:0:6722:0:(genops.c:885:class_export_put()) final put ffff8ab6c3070000/896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:2.0:1788271677.523902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c3070000/896349b1-dd1e-47e2-bcd1-0ecd5d75458e for lustre-OST0000 00000020:00000080:2.0:1788271677.523964:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6c3075800 for lustre-OST0000 00010000:00010000:0.0:1788271678.457849:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271678.912901:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing yml_node 00010000:00010000:1.0:1788271679.474547:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271680.499266:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271681.148227:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:3.0:1788271681.148238:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ab6c3073000/896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:0.0:1788271681.148337:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c3073000/896349b1-dd1e-47e2-bcd1-0ecd5d75458e for lustre-OST0001 00000020:00000080:0.0:1788271681.148703:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6c3076800 for lustre-OST0001 00000100:00100000:2.0:1788271681.523535:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586907648:0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.523617:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271681.523691:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586908160:0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.523702:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907648 00000100:00100000:3.0:1788271681.523710:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907648 00000100:00100000:2.0:1788271681.523717:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271681.523742:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788271681.523748:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586907776:0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.523753:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788271681.523762:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586907648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.523769:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271681.523801:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586908288:0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.523809:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586907648:12345-0@lo:400:kworker.0 Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271681.523822:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788271681.523823:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271681.523851:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586907648:0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.523872:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586908032:0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.523875:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908160 00000100:00100000:2.0:1788271681.523878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908160 00000100:00100000:3.0:1788271681.523897:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271681.523909:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907776 00000100:00100000:2.0:1788271681.523912:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907776 00000100:00100000:3.0:1788271681.523916:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788271681.523921:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586907904:0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.523932:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788271681.523938:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586908160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.523941:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271681.523950:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586908416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271681.523967:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271681.523973:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586908160:12345-0@lo:400:kworker.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271681.523980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788271681.524009:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586907904 00000100:00100000:3.0:1788271681.524010:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908288 00000100:00100000:3.0:1788271681.524013:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908288 00000100:00100000:2.0:1788271681.524013:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586907904 00000100:00100000:2.0:1788271681.524029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788271681.524034:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586907776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.524035:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908032 00000100:00100000:3.0:1788271681.524037:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908032 00000100:00100000:3.0:1788271681.524055:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271681.524061:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586908288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.524067:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586907776:12345-0@lo:400:kworker.0 Request processed in 33us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271681.524073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788271681.524085:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271681.524087:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586908288:12345-0@lo:400:kworker.0 Request processed in 28us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271681.524090:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.524093:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271681.524105:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271681.524110:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586908032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.524118:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586907904:12345-0@lo:400:kworker.0 Request processed in 28us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271681.524124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271681.524134:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586908032:12345-0@lo:400:kworker.0 Request processed in 24us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271681.524139:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271681.524153:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908416 00000100:00100000:3.0:1788271681.524156:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908416 00000100:00100000:2.0:1788271681.524156:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586907904:0@lo:400:kworker.0 00010000:00080000:2.0:1788271681.524168:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e7100 x1875138586908032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271681.524177:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271681.524182:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586908416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271681.524185:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586908032:0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.524211:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586907776:0@lo:400:kworker.0 00002000:00000024:3.0:1788271681.524213:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788271681.524220:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e7480 x1875138586908288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271681.524227:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586908288:0@lo:400:kworker.0 00000100:00100000:2.0:1788271681.524235:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586908160:0@lo:400:kworker.0 00000100:00100000:3.0:1788271681.524247:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586908416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271681.524253:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788271681.524275:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34e300 x1875138586908416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271681.524289:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586908416:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788271681.524707:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271681.524712:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271681.524714:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788271681.524901:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271681.524953:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271681.524963:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586908544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271681.525010:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271681.526310:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908544 00000100:00100000:1.0:1788271681.526331:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908544 00000100:00100000:1.0:1788271681.526391:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788271681.526399:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586908544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271681.526473:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271681.526527:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586908544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271681.526534:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788271681.527603:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0c1500 x1875138586908544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271681.527635:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586908544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271681.647265:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271681.648481:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271681.648598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294912 00000100:00100000:3.0:1788271681.648607:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294912 00000100:00100000:3.0:1788271681.648692:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:3.0:1788271681.648703:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574294912:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271681.648777:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574294912:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 76us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271681.648784:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00080000:0.0:1788271681.649045:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271681.649851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574294784 00000100:00100000:2.0:1788271681.649860:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574294784 00000100:00100000:2.0:1788271681.649905:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 198 00000100:00100000:2.0:1788271681.649915:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574294784:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271681.649969:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574294784:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 56us (2714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271681.649975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 198 00010000:00010000:0.0:1788271682.547373:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271682.754002:0:9245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.64 00010000:00010000:2.0:1788271683.573752:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271684.595356:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788271685.310157:0:9342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.64 00010000:00010000:2.0:1788271685.618643:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271686.642870:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586908672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271686.642960:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.643375:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908672 00000100:00100000:1.0:1788271686.643391:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908672 00000100:00100000:2.0:1788271686.643711:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586909056:0@lo:400:kworker.0 00000100:00100000:1.0:1788271686.643743:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271686.643750:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.643762:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586908672:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271686.643775:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788271686.643779:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271686.643781:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586908928:0@lo:400:kworker.0 00000100:00100000:2.0:1788271686.643799:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.643816:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271686.643823:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586909440:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788271686.643851:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271686.643870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.643925:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788271686.643934:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788271686.644025:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909056 00000100:00100000:0.0:1788271686.644034:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909056 00002000:00000024:1.0:1788271686.644074:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271686.644096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908928 00000100:00100000:0.0:1788271686.644102:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908928 00000100:00100000:0.0:1788271686.644134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788271686.644148:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586909056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271686.644168:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586908672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 411us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.644178:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271686.644201:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909440 00000100:00100000:1.0:1788271686.644206:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909440 00000100:00100000:1.0:1788271686.644234:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271686.644245:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586909056:12345-0@lo:400:kworker.0 Request processed in 93us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.644254:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586909440:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271686.644259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788271686.644291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271686.644303:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586908928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271686.644328:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586908928:12345-0@lo:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.644332:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271686.644353:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586908800:0@lo:400:kworker.0 00000100:00100000:0.0:1788271686.644375:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.644391:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586909312:0@lo:400:kworker.0 00000100:00100000:0.0:1788271686.644404:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.644450:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271686.644453:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586909184:0@lo:400:kworker.0 00000100:00100000:0.0:1788271686.644467:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.644484:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586908800 00000100:00100000:0.0:1788271686.644487:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586908800 00000100:00100000:0.0:1788271686.644505:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788271686.644509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586908800:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788271686.644536:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271686.644540:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586908800:12345-0@lo:400:kworker.0 Request processed in 28us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.644547:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788271686.644581:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909312 00000100:00100000:0.0:1788271686.644583:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909312 00000100:00100000:1.0:1788271686.644605:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586909440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 352us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.644614:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788271686.644623:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271686.644629:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875138586909312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271686.644669:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909184 00000100:00100000:0.0:1788271686.644669:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586909312:12345-0@lo:400:kworker.0 Request processed in 41us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.644681:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909184 00000100:00100000:0.0:1788271686.644682:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271686.644725:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586908800:0@lo:400:kworker.0 00010000:00080000:0.0:1788271686.644748:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f780f800 x1875138586909312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.644757:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271686.644771:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586909312:0@lo:400:kworker.0 00000100:00100000:1.0:1788271686.644777:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586909184:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788271686.644812:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e5f80 x1875138586908672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271686.644834:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586908672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271686.644848:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586909184:12345-0@lo:400:kworker.0 Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.644856:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788271686.644879:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34e300 x1875138586909440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271686.644893:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586909440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271686.644915:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586908928:0@lo:400:kworker.0 00000100:00100000:0.0:1788271686.644925:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586909056:0@lo:400:kworker.0 00000100:00100000:0.0:1788271686.645147:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586909184:0@lo:400:kworker.0 00000100:00080000:2.0:1788271686.645396:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271686.645400:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271686.763465:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271686.763536:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271686.763620:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295040 00000100:00100000:2.0:1788271686.763637:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295040 00000100:00100000:2.0:1788271686.763711:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 200 00000100:00100000:2.0:1788271686.763722:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2353:x1875138574295040:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271686.763811:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2353:x1875138574295040:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.763819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 200 00000100:00100000:0.0:1788271686.763930:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295168 00000100:00100000:0.0:1788271686.763934:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295168 00000100:00100000:0.0:1788271686.764012:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1788271686.764025:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574295168:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271686.764073:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574295168:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 51us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.764080:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00080000:2.0:1788271686.764390:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788271687.640752:0:9441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.64 00010000:00010000:2.0:1788271687.673512:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271688.691288:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271689.613208:0:9490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 10:08:07 EDT 2026 00010000:00010000:2.0:1788271689.715600:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271690.740182:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271691.762593:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586909568:0@lo:400:kworker.0 00000100:00100000:3.0:1788271691.762664:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271691.762853:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271691.762985:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586909952:0@lo:400:kworker.0 00000100:00100000:1.0:1788271691.763019:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271691.763063:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909952 00000100:00100000:1.0:1788271691.763071:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909952 00000100:00100000:1.0:1788271691.763125:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788271691.763135:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586909952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271691.763200:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586909952:12345-0@lo:400:kworker.0 Request processed in 66us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271691.763208:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788271691.763228:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271691.763276:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f780f800 x1875138586909952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271691.763292:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586909952:0@lo:400:kworker.0 00000100:00100000:3.0:1788271691.763692:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586910080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271691.763723:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271691.763755:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909568 00000100:00100000:3.0:1788271691.763760:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909568 00000100:00100000:3.0:1788271691.763800:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788271691.763819:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586909568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271691.763859:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586909568:12345-0@lo:400:kworker.0 Request processed in 53us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.763866:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788271691.763899:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910080 00000100:00100000:3.0:1788271691.763903:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910080 00000100:00100000:3.0:1788271691.763929:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271691.763937:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586910080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271691.763964:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271691.763997:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586910080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.764004:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788271691.764038:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e5f80 x1875138586910080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271691.764052:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586910080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271691.764061:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586909568:0@lo:400:kworker.0 00000100:00100000:3.0:1788271691.766538:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586910464:0@lo:400:kworker.0 00000100:00100000:3.0:1788271691.766605:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271691.766695:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586909696:0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.766726:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271691.766746:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271691.766768:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271691.766789:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788271691.766794:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586909824:0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.766842:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271691.766865:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586910336:0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.766887:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271691.766920:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909696 00000100:00100000:2.0:1788271691.766933:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909696 00000100:00100000:2.0:1788271691.766975:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586909824 00000100:00100000:2.0:1788271691.766978:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586909824 00000100:00100000:2.0:1788271691.766999:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910336 00000100:00100000:2.0:1788271691.767001:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910336 00000100:00100000:2.0:1788271691.767017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788271691.767024:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586909696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.767073:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586909696:12345-0@lo:400:kworker.0 Request processed in 49us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.767079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788271691.767097:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788271691.767104:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586909824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.767130:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586909824:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.767136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788271691.767148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788271691.767167:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586910336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.767194:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586910336:12345-0@lo:400:kworker.0 Request processed in 41us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.767200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788271691.767220:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271691.768474:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586909824:0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.768497:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586910336:0@lo:400:kworker.0 00000100:00100000:2.0:1788271691.768507:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586909696:0@lo:400:kworker.0 00000100:00100000:0.0:1788271691.772552:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910464 00000100:00100000:0.0:1788271691.772565:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910464 00000100:00100000:0.0:1788271691.772624:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788271691.772634:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586910464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271691.772716:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586910464:12345-0@lo:400:kworker.0 Request processed in 84us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.772724:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788271691.772758:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910208 00000100:00100000:0.0:1788271691.772762:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910208 00000100:00100000:0.0:1788271691.772782:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788271691.772788:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586910208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271691.772823:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271691.772857:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586910208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (6088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.772863:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788271691.772881:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788271691.772910:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0c1500 x1875138586910208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271691.772929:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586910208:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788271691.773367:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f780c380 x1875138586910464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271691.773379:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586910464:0@lo:400:kworker.0 00000100:00100000:1.0:1788271691.887662:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271691.887832:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295296 00000100:00100000:3.0:1788271691.887843:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295296 00000100:00100000:3.0:1788271691.887928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 202 00000100:00100000:3.0:1788271691.887939:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574295296:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271691.888015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574295296:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 78us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.888024:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 202 00000100:00100000:1.0:1788271691.892027:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271691.892120:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295424 00000100:00100000:2.0:1788271691.892129:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295424 00000100:00100000:2.0:1788271691.892222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:2.0:1788271691.892233:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574295424:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271691.892325:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574295424:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 94us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.892333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00080000:0.0:1788271691.892717:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271692.787190:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271693.811539:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271694.836681:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271695.859999:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271696.883930:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586910592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271696.884002:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271696.887994:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888063:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271696.888113:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586911232:0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888140:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271696.888163:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271696.888169:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586910848:0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888195:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271696.888228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910848 00000100:00100000:2.0:1788271696.888235:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910848 00000100:00100000:2.0:1788271696.888513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788271696.888524:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586910848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586910848:12345-0@lo:400:kworker.0 Request processed in 52us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271696.888581:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788271696.888622:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586911104:0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888647:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271696.888667:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271696.888672:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586910976:0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888705:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271696.888742:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586911104 00000100:00100000:2.0:1788271696.888745:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586911104 00000100:00100000:2.0:1788271696.888773:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910976 00000100:00100000:2.0:1788271696.888776:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910976 00000100:00100000:2.0:1788271696.888790:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788271696.888795:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586911104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888824:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586911104:12345-0@lo:400:kworker.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271696.888830:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788271696.888841:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788271696.888846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586910976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.888882:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586910976:12345-0@lo:400:kworker.0 Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271696.888887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788271696.889014:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271696.889047:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586910848:0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.889700:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586910976:0@lo:400:kworker.0 00000100:00100000:2.0:1788271696.889711:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586911104:0@lo:400:kworker.0 00000100:00100000:0.0:1788271696.897400:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586911360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271696.897485:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271696.897548:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910592 00000100:00100000:0.0:1788271696.897556:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910592 00000100:00100000:0.0:1788271696.897617:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586911360 00000100:00100000:0.0:1788271696.897620:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586911360 00000100:00100000:0.0:1788271696.897640:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271696.897649:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586910592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271696.897683:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271696.897750:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586910592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (13747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271696.897758:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271696.897787:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788271696.897793:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586911360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271696.897810:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271696.897854:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586911360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271696.897862:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788271696.897878:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271696.897883:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788271696.898223:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b4380 x1875138586910592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271696.898245:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586910592:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788271696.898294:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e6a00 x1875138586911360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271696.898305:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586911360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271696.901737:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586911232 00000100:00100000:1.0:1788271696.901765:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586911232 00000100:00100000:1.0:1788271696.901845:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271696.901857:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586911232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271696.902456:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586911232:12345-0@lo:400:kworker.0 Request processed in 600us (14312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.902464:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788271696.902518:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b5180 x1875138586911232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.902534:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586911232:0@lo:400:kworker.0 00010000:00010000:1.0:1788271696.902598:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271696.902978:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586910720 00000100:00100000:3.0:1788271696.902985:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586910720 00000100:00100000:3.0:1788271696.903020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788271696.903029:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586910720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271696.903492:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586910720:12345-0@lo:400:kworker.0 Request processed in 463us (15428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271696.903500:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788271696.909489:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788271697.006833:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271697.006884:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271697.006930:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295680 00000100:00100000:2.0:1788271697.006940:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295680 00000100:00100000:2.0:1788271697.007012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1788271697.007020:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574295680:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271697.007112:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574295680:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271697.007120:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:0.0:1788271697.010774:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295552 00000100:00100000:0.0:1788271697.010789:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295552 00000100:00100000:0.0:1788271697.011008:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 204 00000100:00100000:0.0:1788271697.011020:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2352:x1875138574295552:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271697.011139:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2352:x1875138574295552:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 121us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271697.011147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 204 00000100:00080000:0.0:1788271697.011212:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271697.908223:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271698.931553:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271699.955830:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271700.980017:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271702.002808:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586911488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271702.002868:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586911744:0@lo:400:kworker.0 00000100:00100000:0.0:1788271702.002887:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271702.002978:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271702.003004:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586911488 00000100:00100000:3.0:1788271702.003012:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586911488 00000100:00100000:3.0:1788271702.003067:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271702.003077:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586911488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271702.003109:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271702.003194:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.003249:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586912256:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.003286:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.003315:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271702.003322:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586911872:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.003343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.003369:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586911616:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.003397:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.003442:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586912128:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.003463:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.003482:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271702.003499:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586912000:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.003532:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.003557:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586911744 00000100:00100000:1.0:1788271702.003561:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586911744 00000100:00100000:1.0:1788271702.003587:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586911872 00000100:00100000:1.0:1788271702.003590:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586911872 00000100:00100000:1.0:1788271702.003602:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912128 00000100:00100000:1.0:1788271702.003604:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912128 00000100:00100000:1.0:1788271702.003617:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788271702.003624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586911744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.005440:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586911744:12345-0@lo:400:kworker.0 Request processed in 1790us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.005453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788271702.005839:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788271702.005902:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586911872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.005947:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586911872:12345-0@lo:400:kworker.0 Request processed in 99us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.005954:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271702.006148:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586912384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271702.006189:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271702.006246:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912384 00000100:00100000:2.0:1788271702.006253:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912384 00000100:00100000:2.0:1788271702.006285:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271702.006293:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586912384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271702.006320:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271702.006357:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586912384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.006364:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788271702.006398:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b7800 x1875138586912384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271702.006434:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586912384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271702.006477:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271702.006486:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586912128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271702.006523:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586912128:12345-0@lo:400:kworker.0 Request processed in 39us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.006529:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271702.006552:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586911616 00000100:00100000:2.0:1788271702.006557:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586911616 00000100:00100000:2.0:1788271702.006589:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788271702.006609:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586911616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271702.006658:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586911616:12345-0@lo:400:kworker.0 Request processed in 51us (3260us total) trans 0 rc 0/0 00000100:00080000:0.0:1788271702.007156:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271702.007162:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271702.007165:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271702.007181:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912256 00000100:00100000:0.0:1788271702.007186:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912256 00000100:00100000:0.0:1788271702.007225:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912000 00000100:00100000:0.0:1788271702.007229:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912000 00000100:00100000:0.0:1788271702.007251:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271702.007259:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586912256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271702.007298:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586912256:12345-0@lo:400:kworker.0 Request processed in 40us (4011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.007305:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271702.007331:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788271702.007338:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586912000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271702.007373:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586912000:12345-0@lo:400:kworker.0 Request processed in 36us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.007379:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788271702.007390:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee24ed80 x1875138586912000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271702.007403:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586912000:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.007434:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586911616:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.007446:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586912128:0@lo:400:kworker.0 00000100:00100000:2.0:1788271702.008132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788271702.009675:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586911872:0@lo:400:kworker.0 00000100:00100000:1.0:1788271702.009693:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586911744:0@lo:400:kworker.0 00010000:00080000:1.0:1788271702.009729:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee24e680 x1875138586912256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271702.009741:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586912256:0@lo:400:kworker.0 00000100:00100000:3.0:1788271702.011684:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586911488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8600us (8790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.011699:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788271702.013651:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e6a00 x1875138586911488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271702.013680:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586911488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271702.123523:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271702.124219:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295808 00000100:00100000:3.0:1788271702.124230:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295808 00000100:00100000:3.0:1788271702.124406:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 206 00000100:00100000:3.0:1788271702.124447:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574295808:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271702.124523:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574295808:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 79us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.124550:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 206 00000100:00100000:2.0:1788271702.125954:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271702.126208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574295936 00000100:00100000:0.0:1788271702.126216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574295936 00000100:00100000:0.0:1788271702.126389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:0.0:1788271702.126400:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574295936:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271702.126504:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574295936:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.126512:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00080000:2.0:1788271702.127065:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788271703.027454:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788271703.745894:0:10120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:08:21 (1788271701) === 00010000:00010000:3.0:1788271704.054223:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271704.207002:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271704.207235:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296064 00000100:00100000:3.0:1788271704.207246:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296064 00000100:00100000:3.0:1788271704.207311:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:3.0:1788271704.207322:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+10:8155:x1875138574296064:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788271704.207339:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271704.207359:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19e00/0xbeb05ca97b5f7264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7693264610237b1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.207390:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19e00/0xbeb05ca97b5f7264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237b1 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.207401:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19e00/0xbeb05ca97b5f7264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237b1 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.207541:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19e00, rc 0) 00000100:00100000:3.0:1788271704.207779:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8155:x1875138574296064:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 459us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.207787:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:1.0:1788271704.218365:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271704.219847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296192 00000100:00100000:3.0:1788271704.219865:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296192 00000100:00100000:3.0:1788271704.219987:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 208 00000100:00100000:3.0:1788271704.220002:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8155:x1875138574296192:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788271704.222504:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8155:x1875138574296192:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 2489us (4137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.222541:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 208 00000100:00100000:2.0:1788271704.240920:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271704.241100:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296320 00000100:00100000:0.0:1788271704.241115:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296320 00000100:00100000:0.0:1788271704.241205:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 209 00000100:00100000:0.0:1788271704.241218:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8155:x1875138574296320:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788271704.241640:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8155:x1875138574296320:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 423us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.241649:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 209 00000100:00100000:2.0:1788271704.244254:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271704.244392:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296448 00000100:00100000:3.0:1788271704.244405:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296448 00000100:00100000:3.0:1788271704.244498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 210 00000100:00100000:3.0:1788271704.244510:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8159:x1875138574296448:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271704.244929:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8159:x1875138574296448:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 418us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.244948:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 210 00000100:00100000:1.0:1788271704.261919:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271704.262253:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296576 00000100:00100000:2.0:1788271704.262268:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296576 00000100:00100000:2.0:1788271704.262348:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:2.0:1788271704.262361:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8159:x1875138574296576:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788271704.263660:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8159:x1875138574296576:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 1291us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.263676:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:3.0:1788271704.275214:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271704.275336:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296704 00000100:00100000:0.0:1788271704.275351:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296704 00000100:00100000:0.0:1788271704.275449:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 212 00000100:00100000:0.0:1788271704.275461:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+11:8155:x1875138574296704:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788271704.275483:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271704.275507:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f726b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7693264610237db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.275551:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237db expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.275564:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237db expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.275575:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0030a00, rc 0) 00000100:00100000:0.0:1788271704.275675:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:8155:x1875138574296704:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 216us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.275704:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 212 00000100:00100000:2.0:1788271704.283696:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271704.285464:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296832 00000100:00100000:3.0:1788271704.285484:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296832 00000100:00100000:3.0:1788271704.285568:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:3.0:1788271704.285583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+12:8155:x1875138574296832:12345-192.168.201.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788271704.285633:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788271704.285666:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788271704.285671:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788271704.285674:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788271704.285677:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788271704.290151:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+12:8155:x1875138574296832:12345-192.168.201.1@tcp:256:mount.lustre.0 Request processed in 4551us (6449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.290172:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:3.0:1788271704.296097:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271704.298527:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574296960 00000100:00100000:1.0:1788271704.298548:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574296960 00000100:00100000:1.0:1788271704.298694:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 214 00000100:00100000:1.0:1788271704.298710:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+12:8155:x1875138574296960:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788271704.298736:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271704.298761:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7693264610237e2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.298802:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.298815:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.298827:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6600, rc 0) 00000100:00100000:1.0:1788271704.298985:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8155:x1875138574296960:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 278us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.299001:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 214 00000100:00100000:2.0:1788271704.301867:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271704.302099:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297088 00000100:00100000:3.0:1788271704.302114:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297088 00000100:00100000:3.0:1788271704.302247:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:3.0:1788271704.302261:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8155:x1875138574297088:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788271704.303204:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8155:x1875138574297088:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 939us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.303217:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:2.0:1788271704.308758:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271704.309240:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297216 00000100:00100000:1.0:1788271704.309255:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297216 00000100:00100000:0.0:1788271704.309533:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:0.0:1788271704.309548:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8155:x1875138574297216:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788271704.310080:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8155:x1875138574297216:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 534us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.310091:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:3.0:1788271704.318224:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271704.318490:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297344 00000100:00100000:2.0:1788271704.318504:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297344 00000100:00100000:2.0:1788271704.318576:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:2.0:1788271704.318598:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8163:x1875138574297344:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788271704.319021:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8163:x1875138574297344:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 434us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.319030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:2.0:1788271704.334352:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271704.338500:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297472 00000100:00100000:0.0:1788271704.338525:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297472 00000100:00100000:0.0:1788271704.338685:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:0.0:1788271704.338698:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8163:x1875138574297472:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271704.340739:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:8163:x1875138574297472:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 2028us (6386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.340758:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:0.0:1788271704.346857:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271704.346906:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271704.346998:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297600 00000100:00100000:1.0:1788271704.347013:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297600 00000100:00100000:1.0:1788271704.347066:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297984 00000100:00100000:1.0:1788271704.347070:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297984 00000100:00080000:3.0:1788271704.347275:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271704.347314:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:1.0:1788271704.347331:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574297984:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271704.347470:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574297984:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 144us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.347479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:1.0:1788271704.347500:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1788271704.347505:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1875138574297600:12345-192.168.201.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788271704.347532:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d5ae6258-8c0a-484f-8e0e-8fd260991b76@192.168.201.1@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1788271704.347577:0:5839:0:(genops.c:1385:class_connect()) connect: client d5ae6258-8c0a-484f-8e0e-8fd260991b76, cookie 0xbeb05ca97b5f7279 00000004:00100000:1.0:1788271704.347630:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1788271704.348687:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca688800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271704.348978:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2350:x1875138574297600:12345-192.168.201.1@tcp:38:mount.lustre.0 Request processed in 1468us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.348990:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1788271704.355810:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271704.356004:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297728 00000100:00100000:2.0:1788271704.356018:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297728 00000100:00080000:3.0:1788271704.356247:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271704.356322:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1788271704.356338:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:0:x1875138574297728:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788271704.356402:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788271704.356547:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:0:x1875138574297728:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 212us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.356555:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1788271704.365556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271704.366128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574297856 00000100:00100000:3.0:1788271704.366191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574297856 00000100:00100000:2.0:1788271704.366541:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1788271704.366556:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:8155:x1875138574297856:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788271704.366612:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788271704.366767:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:8155:x1875138574297856:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 214us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.366776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:3.0:1788271704.369299:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271704.369568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574298112 00000100:00100000:2.0:1788271704.369581:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574298112 00000100:00100000:2.0:1788271704.369667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:2.0:1788271704.369680:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:8155:x1875138574298112:12345-192.168.201.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788271704.369798:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:8155:x1875138574298112:12345-192.168.201.1@tcp:40:mount.lustre.0 Request processed in 120us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.369828:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:0.0:1788271704.373848:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271704.373895:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271704.373932:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271704.373982:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574298240 00000100:00100000:0.0:1788271704.373995:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574298240 00000100:00100000:0.0:1788271704.374040:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574298368 00000100:00100000:0.0:1788271704.374043:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574298368 00000100:00100000:0.0:1788271704.374064:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:0.0:1788271704.374073:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875138574298240:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788271704.374139:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d5ae6258-8c0a-484f-8e0e-8fd260991b76@192.168.201.1@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1788271704.374181:0:6697:0:(genops.c:1385:class_connect()) connect: client d5ae6258-8c0a-484f-8e0e-8fd260991b76, cookie 0xbeb05ca97b5f7280 00002000:00100000:0.0:1788271704.374197:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d5ae6258-8c0a-484f-8e0e-8fd260991b76/ffff8ab6ee0eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271704.374232:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788271704.374605:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788271704.374651:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271704.374748:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2350:x1875138574298240:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 673us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.374757:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:0.0:1788271704.374798:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:0.0:1788271704.374804:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875138574298368:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788271704.374824:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d5ae6258-8c0a-484f-8e0e-8fd260991b76@192.168.201.1@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1788271704.374844:0:6697:0:(genops.c:1385:class_connect()) connect: client d5ae6258-8c0a-484f-8e0e-8fd260991b76, cookie 0xbeb05ca97b5f7287 00002000:00100000:0.0:1788271704.374851:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d5ae6258-8c0a-484f-8e0e-8fd260991b76/ffff8ab6ee0e8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271704.374870:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788271704.375014:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788271704.375032:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271704.375060:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2350:x1875138574298368:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 254us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.375067:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271704.375623:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574298496 00000100:00100000:3.0:1788271704.375631:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574298496 00000100:00100000:3.0:1788271704.375688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:3.0:1788271704.375697:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:8155:x1875138574298496:12345-192.168.201.1@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788271704.375931:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788271704.376092:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:8155:x1875138574298496:12345-192.168.201.1@tcp:33:mount.lustre.0 Request processed in 394us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.376099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00010000:00010000:1.0:1788271705.074951:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271706.099830:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271706.677834:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5ae6258-8c0a-484f-8e0e-8fd260991b76 00000001:00100000:2.0:1788271706.682294:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5ae6258-8c0a-484f-8e0e-8fd260991b76 00010000:00010000:1.0:1788271707.126670:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271707.127281:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586912512:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.127387:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.127482:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586913024:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.127512:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.127555:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788271707.127562:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586912640:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.127594:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.127613:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586913152:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.127639:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.127675:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586912768:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.127719:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.127743:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271707.127749:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586912896:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.127774:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.127816:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912512 00000100:00100000:3.0:1788271707.127827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912512 00000100:00100000:3.0:1788271707.127901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788271707.127914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586912512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.128157:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586912512:12345-0@lo:400:kworker.0 Request processed in 244us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.128166:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788271707.128214:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913024 00000100:00100000:3.0:1788271707.128218:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913024 00000100:00100000:3.0:1788271707.128255:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912640 00000100:00100000:3.0:1788271707.128259:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912640 00000100:00100000:3.0:1788271707.128271:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912768 00000100:00100000:3.0:1788271707.128274:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912768 00000100:00100000:3.0:1788271707.128290:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788271707.128296:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586913024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.128333:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586913024:12345-0@lo:400:kworker.0 Request processed in 38us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.128340:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788271707.128351:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788271707.128357:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586912640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.128381:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586912640:12345-0@lo:400:kworker.0 Request processed in 24us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.128386:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788271707.128405:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788271707.128438:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586912768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.128473:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586912768:12345-0@lo:400:kworker.0 Request processed in 62us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.128479:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788271707.128502:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913152 00000100:00100000:3.0:1788271707.128506:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913152 00000100:00100000:3.0:1788271707.128536:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586912896 00000100:00100000:3.0:1788271707.128538:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586912896 00000100:00100000:3.0:1788271707.128633:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271707.128644:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586913152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.128679:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586913152:12345-0@lo:400:kworker.0 Request processed in 38us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.128685:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271707.128698:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271707.128704:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586912896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.128730:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586912896:12345-0@lo:400:kworker.0 Request processed in 27us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.128736:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788271707.128772:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271707.128778:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271707.128781:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788271707.128832:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34df80 x1875138586912896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271707.128850:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586912896:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.128867:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586912768:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.130241:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586912640:0@lo:400:kworker.0 00010000:00080000:3.0:1788271707.130265:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34ea00 x1875138586913152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271707.130277:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586913152:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.130290:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586912512:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.130305:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586913024:0@lo:400:kworker.0 00000100:00100000:3.0:1788271707.134663:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271707.134774:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.134841:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271707.134851:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586913280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271707.134876:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271707.135002:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913408 00000100:00100000:3.0:1788271707.135012:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913408 00000100:00100000:3.0:1788271707.135074:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913280 00000100:00100000:3.0:1788271707.135077:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913280 00000100:00100000:3.0:1788271707.135096:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788271707.135108:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586913408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271707.135183:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271707.135237:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.135246:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788271707.135271:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788271707.135277:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586913280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271707.135300:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271707.135339:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586913280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.135346:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788271707.135395:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0e5880 x1875138586913280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271707.135441:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586913280:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788271707.135453:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6fe9caa00 x1875138586913408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271707.135466:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586913408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788271708.152997:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271708.248952:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5ae6258-8c0a-484f-8e0e-8fd260991b76 00010000:00010000:1.0:1788271709.170825:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271709.814579:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271709.819965:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574298624 00000100:00100000:3.0:1788271709.819996:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574298624 00000100:00100000:3.0:1788271709.820094:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:3.0:1788271709.820109:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574298624:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271709.820221:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574298624:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 116us (5651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271709.820230:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:1.0:1788271709.826085:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271709.826132:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271709.826253:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299008 00000100:00100000:2.0:1788271709.826265:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299008 00000100:00100000:2.0:1788271709.826361:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:2.0:1788271709.826374:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299008:12345-192.168.201.1@tcp:400:kworker.0 00000100:00080000:1.0:1788271709.826489:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271709.826628:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299008:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 256us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271709.826638:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1788271709.828230:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574298752 00000100:00100000:3.0:1788271709.828247:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574298752 00000100:00100000:2.0:1788271709.843203:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271709.843258:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271709.843304:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299136 00000100:00100000:2.0:1788271709.843318:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299136 00000100:00100000:2.0:1788271709.843380:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:2.0:1788271709.843394:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574299136:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271709.843521:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574299136:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 131us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271709.843530:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:3.0:1788271709.844106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574298880 00000100:00100000:3.0:1788271709.844115:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574298880 00000100:00100000:3.0:1788271709.844171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:3.0:1788271709.844181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574298880:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271709.844246:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574298880:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 66us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271709.844273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:0.0:1788271709.845946:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:0.0:1788271709.845969:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574298752:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271709.853218:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574298752:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 7240us (27130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271709.853239:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00080000:2.0:1788271709.855458:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271709.855469:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271710.196985:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788271710.384371:0:10317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788271711.219529:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271712.242809:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271712.243547:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271712.243578:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586913536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271712.243669:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271712.243761:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913536 00000100:00100000:2.0:1788271712.243780:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913536 00000100:00100000:2.0:1788271712.243864:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788271712.243886:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586913536:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788271712.244405:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271712.245182:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586913792:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.245256:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.245302:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586914304:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.245332:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.245359:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271712.245365:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586913920:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.245392:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.245468:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913792 00000100:00100000:3.0:1788271712.245476:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913792 00000100:00100000:3.0:1788271712.245526:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788271712.245536:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586913792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.245591:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586913792:12345-0@lo:400:kworker.0 Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.245599:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788271712.245645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913920 00000100:00100000:3.0:1788271712.245649:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913920 00000100:00100000:3.0:1788271712.245676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271712.245683:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586913920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.245717:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586913920:12345-0@lo:400:kworker.0 Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.245724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271712.245749:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586913664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271712.245777:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.245824:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586914176:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.245848:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.245869:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271712.245875:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586914048:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.245912:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.245939:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914176 00000100:00100000:3.0:1788271712.245943:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914176 00000100:00100000:3.0:1788271712.245971:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914048 00000100:00100000:3.0:1788271712.245974:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914048 00000100:00100000:3.0:1788271712.245989:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271712.245995:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586914176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.246044:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586914176:12345-0@lo:400:kworker.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.246050:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271712.246063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788271712.247232:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586913664 00000100:00100000:0.0:1788271712.247244:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586913664 00000100:00100000:0.0:1788271712.247307:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788271712.247318:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586913664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271712.247361:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271712.247467:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586913664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.247475:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788271712.247520:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271712.247525:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271712.247617:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586913920:0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.247633:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586913792:0@lo:400:kworker.0 00010000:00080000:0.0:1788271712.247678:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee24d880 x1875138586913664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.247698:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586913664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271712.247712:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586914176:0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.247753:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914304 00000100:00100000:0.0:1788271712.247757:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914304 00000100:00100000:0.0:1788271712.247788:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271712.247795:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586914304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.247853:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586914304:12345-0@lo:400:kworker.0 Request processed in 58us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.247859:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788271712.247886:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee24f800 x1875138586914304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.247895:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586914304:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.252237:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586914048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.252401:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586914048:12345-0@lo:400:kworker.0 Request processed in 6330us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.252444:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00002000:00000024:3.0:1788271712.252549:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271712.252593:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586913536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8720us (8924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.252602:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788271712.252772:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586914048:0@lo:400:kworker.0 00010000:00080000:0.0:1788271712.252793:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b5880 x1875138586913536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.252817:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586913536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788271713.266853:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271714.291141:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271714.923267:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271714.923339:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271714.923385:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271714.923682:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299776 00000100:00100000:3.0:1788271714.923693:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299776 00000100:00100000:1.0:1788271714.923756:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299520 00000100:00100000:1.0:1788271714.923761:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299520 00000100:00100000:3.0:1788271714.923778:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:3.0:1788271714.923792:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299776:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271714.923795:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:1.0:1788271714.923804:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299520:12345-192.168.201.1@tcp:400:kworker.0 00000100:00080000:2.0:1788271714.923886:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271714.923891:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271714.923954:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299776:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 166us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271714.923962:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:0.0:1788271714.924120:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299264 00000100:00100000:0.0:1788271714.924126:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299264 00000100:00100000:0.0:1788271714.924165:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:0.0:1788271714.924173:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574299264:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271714.929541:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299520:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 5722us (6187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271714.929558:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:0.0:1788271714.929963:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574299264:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 5787us (6704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271714.929974:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:3.0:1788271714.930295:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271714.930823:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271714.931174:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299648 00000100:00100000:2.0:1788271714.931185:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299648 00000100:00100000:2.0:1788271714.931266:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:2.0:1788271714.931277:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299648:12345-192.168.201.1@tcp:400:kworker.0 00000100:00080000:3.0:1788271714.931483:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271714.931550:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574299648:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 274us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271714.931559:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:0.0:1788271714.932228:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299392 00000100:00100000:0.0:1788271714.932237:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299392 00000100:00100000:0.0:1788271714.932300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:0.0:1788271714.932310:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574299392:12345-192.168.201.1@tcp:400:kworker.0 00000100:00080000:3.0:1788271714.932437:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271714.932679:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574299392:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 370us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271714.932687:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 72 00010000:00010000:2.0:1788271715.321012:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271716.348660:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271717.364625:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271717.364645:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586914560:0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.364810:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586914432:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.366834:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271717.366989:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586914816:0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.368627:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271717.368688:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586914944:0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.372644:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271717.372765:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914432 00000100:00100000:1.0:1788271717.372774:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914432 00000100:00100000:1.0:1788271717.372823:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788271717.372832:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586914432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.372889:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586914432:12345-0@lo:400:kworker.0 Request processed in 57us (4267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.372896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788271717.373155:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586914432:0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.373358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914560 00000100:00100000:1.0:1788271717.373371:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914560 00000100:00100000:1.0:1788271717.373408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914944 00000100:00100000:1.0:1788271717.373456:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914944 00000100:00100000:1.0:1788271717.373490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788271717.373498:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586914560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.373538:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586914560:12345-0@lo:400:kworker.0 Request processed in 41us (6711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.373545:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788271717.373557:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271717.373563:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586914944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.373596:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586914944:12345-0@lo:400:kworker.0 Request processed in 33us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.373602:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788271717.373617:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271717.373637:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586914944:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.378082:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586914688:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.378152:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.378186:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586915200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271717.378235:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.378291:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914688 00000100:00100000:2.0:1788271717.378299:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914688 00000100:00100000:2.0:1788271717.378357:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788271717.378381:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586914688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.378475:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586914688:12345-0@lo:400:kworker.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.378482:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788271717.378564:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586914688:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.378594:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586914560:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.378601:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586915072:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.378627:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.378650:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915072 00000100:00100000:2.0:1788271717.378653:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915072 00000100:00100000:2.0:1788271717.378688:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788271717.378695:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586915072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.378740:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586915072:12345-0@lo:400:kworker.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.378747:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788271717.378777:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f780d500 x1875138586915072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271717.378789:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586915072:0@lo:400:kworker.0 00000100:00080000:1.0:1788271717.379188:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271717.379193:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271717.379202:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271717.379213:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586915328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271717.379251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271717.379307:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915200 00000100:00100000:1.0:1788271717.379312:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915200 00000100:00100000:1.0:1788271717.379340:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915328 00000100:00100000:1.0:1788271717.379343:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915328 00000100:00100000:1.0:1788271717.379375:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271717.379383:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586915200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271717.379444:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271717.379483:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586915200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.379497:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271717.379510:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788271717.379516:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586915328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271717.379533:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271717.379565:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586915328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.379570:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788271717.379586:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271717.379604:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee24ca80 x1875138586915200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271717.379618:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586915200:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788271717.379641:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6edf2aa00 x1875138586915328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271717.379652:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586915328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271717.382145:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271717.382843:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586914816 00000100:00100000:1.0:1788271717.382852:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586914816 00000100:00100000:1.0:1788271717.382905:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788271717.383178:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586914816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.383298:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586914816:12345-0@lo:400:kworker.0 Request processed in 125us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.383306:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788271717.388853:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f780c380 x1875138586914816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271717.388872:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586914816:0@lo:400:kworker.0 00010000:00010000:1.0:1788271718.386583:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271719.410745:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271720.052228:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271720.052278:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271720.052302:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271720.052351:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271720.052378:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271720.052443:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300032 00000100:00100000:1.0:1788271720.052452:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300032 00000100:00100000:1.0:1788271720.052500:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300160 00000100:00100000:1.0:1788271720.052503:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300160 00000100:00100000:1.0:1788271720.052522:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:1.0:1788271720.052530:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574300032:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271720.052600:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574300032:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 69us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271720.052608:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:1.0:1788271720.052627:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:1.0:1788271720.052634:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574300160:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271720.052658:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574300160:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271720.052691:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574299904 00000100:00100000:0.0:1788271720.052695:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574299904 00000100:00100000:0.0:1788271720.052720:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:0.0:1788271720.052727:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574299904:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271720.052736:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:1.0:1788271720.052760:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300416 00000100:00100000:1.0:1788271720.052764:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300416 00000100:00100000:1.0:1788271720.052790:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300288 00000100:00100000:1.0:1788271720.052793:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300288 00000100:00100000:0.0:1788271720.052807:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574299904:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 80us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271720.052813:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:1.0:1788271720.052819:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:1.0:1788271720.052827:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574300416:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271720.052858:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574300416:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271720.052876:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:1.0:1788271720.052889:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:1.0:1788271720.052895:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574300288:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271720.052926:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574300288:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 31us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271720.052933:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00080000:1.0:1788271720.052954:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271720.052957:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271720.052960:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788271720.434592:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271721.466094:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271722.483628:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586915456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271722.483723:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271722.483798:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586915584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271722.483948:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271722.483989:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271722.484002:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915456 00000100:00100000:1.0:1788271722.484009:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915456 00000100:00100000:1.0:1788271722.484062:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915584 00000100:00100000:1.0:1788271722.484074:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915584 00000100:00100000:1.0:1788271722.484095:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271722.484104:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586915456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271722.484137:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271722.484314:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586915456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.484322:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271722.484341:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271722.484347:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586915584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271722.484368:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271722.484397:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586915584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.484442:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788271722.484463:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271722.484466:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271722.484493:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee24f100 x1875138586915584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271722.484511:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586915584:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788271722.484541:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee24d880 x1875138586915456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271722.484553:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586915456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271722.498265:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586915712:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.498356:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271722.498595:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271722.498602:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586916096:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.498643:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271722.498690:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586915840:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.498722:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271722.498741:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271722.498747:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586915968:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.498769:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271722.498798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916096 00000100:00100000:1.0:1788271722.498804:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916096 00000100:00100000:1.0:1788271722.498867:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915840 00000100:00100000:1.0:1788271722.498871:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915840 00000100:00100000:1.0:1788271722.498885:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915968 00000100:00100000:1.0:1788271722.498888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915968 00000100:00100000:1.0:1788271722.498917:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788271722.498925:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586916096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.498976:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586916096:12345-0@lo:400:kworker.0 Request processed in 52us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.498983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788271722.499001:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788271722.499008:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586915840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.499039:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586915840:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.499045:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788271722.499075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788271722.499082:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586915968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.499110:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586915968:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.499115:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788271722.499135:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271722.499176:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586915968:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.499190:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586915840:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.499223:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586916096:0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.508792:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586915712 00000100:00100000:0.0:1788271722.508806:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586915712 00000100:00100000:2.0:1788271722.509317:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788271722.509332:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586915712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.509464:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586915712:12345-0@lo:400:kworker.0 Request processed in 136us (11108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.509471:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788271722.509591:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586915712:0@lo:400:kworker.0 00010000:00010000:2.0:1788271723.506907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271724.532956:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271725.172735:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271725.172780:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271725.172814:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300672 00000100:00100000:3.0:1788271725.172823:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300672 00000100:00100000:3.0:1788271725.172884:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:3.0:1788271725.172895:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574300672:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271725.172970:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574300672:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271725.172978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00080000:3.0:1788271725.173002:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271725.173351:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300544 00000100:00100000:0.0:1788271725.173356:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300544 00000100:00100000:0.0:1788271725.173397:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:0.0:1788271725.173405:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2352:x1875138574300544:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271725.173469:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2352:x1875138574300544:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 64us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271725.173476:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:1.0:1788271725.186326:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271725.186381:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271725.186459:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271725.186488:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300800 00000100:00100000:1.0:1788271725.186497:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300800 00000100:00100000:1.0:1788271725.186559:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:1.0:1788271725.186583:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2351:x1875138574300800:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271725.186658:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2351:x1875138574300800:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271725.186666:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:1.0:1788271725.186690:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574300928 00000100:00100000:1.0:1788271725.186694:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574300928 00000100:00100000:1.0:1788271725.186719:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301056 00000100:00100000:1.0:1788271725.186722:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301056 00000100:00100000:1.0:1788271725.186740:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1788271725.186747:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2350:x1875138574300928:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:1.0:1788271725.186765:0:8463:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7280 00000100:00080000:1.0:1788271725.186773:0:8463:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0ed000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271725.186806:0:8463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788271725.187158:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+2:2350:x1875138574300928:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 410us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271725.188753:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1788271725.188783:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1788271725.188796:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2350:x1875138574301056:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:1.0:1788271725.188820:0:8463:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7287 00000100:00080000:1.0:1788271725.188828:0:8463:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0e9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271725.188901:0:8463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788271725.189159:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+2:2350:x1875138574301056:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 367us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271725.189177:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00080000:0.0:1788271725.191817:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271725.191826:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271725.191829:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788271725.195353:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271725.197392:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271725.557920:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271726.578730:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271727.126972:0:11018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788271727.179824:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5ae6258-8c0a-484f-8e0e-8fd260991b76 00000020:00000080:3.0:1788271727.179833:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ab6ee0e8800/d5ae6258-8c0a-484f-8e0e-8fd260991b76 00000020:00000080:0.0:1788271727.179857:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ee0e8800/d5ae6258-8c0a-484f-8e0e-8fd260991b76 for lustre-OST0001 00000020:00000080:0.0:1788271727.179928:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6ee0e9800 for lustre-OST0001 00000100:00100000:1.0:1788271727.602949:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586916608:0@lo:400:kworker.0 00000100:00100000:1.0:1788271727.603019:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271727.603086:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788271727.603093:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586916224:0@lo:400:kworker.0 00000100:00100000:1.0:1788271727.603123:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271727.603147:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586916736:0@lo:400:kworker.0 00000100:00100000:1.0:1788271727.603194:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271727.603223:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586916352:0@lo:400:kworker.0 00000100:00100000:1.0:1788271727.603246:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271727.603264:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586916864:0@lo:400:kworker.0 00000100:00100000:1.0:1788271727.603286:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271727.603303:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271727.603308:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586916480:0@lo:400:kworker.0 00000100:00100000:1.0:1788271727.603340:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271727.603372:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916608 00000100:00100000:1.0:1788271727.603380:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916608 00000100:00080000:0.0:1788271727.603545:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271727.603575:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916864 00000100:00100000:0.0:1788271727.603580:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916864 00000100:00100000:0.0:1788271727.603625:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788271727.603635:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586916608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.603689:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586916608:12345-0@lo:400:kworker.0 Request processed in 55us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.603696:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788271727.603712:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788271727.603718:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586916864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.603747:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586916864:12345-0@lo:400:kworker.0 Request processed in 30us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.603753:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788271727.603780:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916736 00000100:00100000:0.0:1788271727.603783:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916736 00000100:00100000:0.0:1788271727.603807:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916352 00000100:00100000:0.0:1788271727.603811:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916352 00000100:00100000:0.0:1788271727.603821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916480 00000100:00100000:0.0:1788271727.603823:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916480 00000100:00100000:0.0:1788271727.603835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788271727.603841:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586916736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.603870:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586916736:12345-0@lo:400:kworker.0 Request processed in 30us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.603876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788271727.603889:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788271727.603895:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586916352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.603939:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586916352:12345-0@lo:400:kworker.0 Request processed in 44us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.603944:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788271727.603958:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788271727.603963:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586916480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.603984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586916480:12345-0@lo:400:kworker.0 Request processed in 21us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.603989:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788271727.604008:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916224 00000100:00100000:0.0:1788271727.604011:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916224 00000100:00100000:0.0:1788271727.604032:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788271727.604038:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586916224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.604063:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586916224:12345-0@lo:400:kworker.0 Request processed in 26us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.604069:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1788271727.604096:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271727.604098:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271727.604124:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586916480:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.604134:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586916352:0@lo:400:kworker.0 00010000:00080000:0.0:1788271727.604144:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cab9b800 x1875138586916864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.604154:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586916864:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.604179:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586916224:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.604199:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586916736:0@lo:400:kworker.0 00010000:00080000:0.0:1788271727.604215:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cab9bb80 x1875138586916608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.604224:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586916608:0@lo:400:kworker.0 00000100:00100000:2.0:1788271727.604632:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271727.604643:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586916992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271727.604678:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271727.604756:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271727.605497:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586916992 00000100:00100000:1.0:1788271727.605504:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586916992 00000100:00100000:1.0:1788271727.605550:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788271727.605559:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586916992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271727.605589:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271727.605696:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586916992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271727.605703:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788271727.607396:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586917120:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788271727.607567:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6edf29f80 x1875138586916992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271727.607585:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586916992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271727.607725:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271727.607846:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586917120 00000100:00100000:1.0:1788271727.607854:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586917120 00000100:00100000:1.0:1788271727.607938:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788271727.607961:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586917120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271727.608003:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271727.608050:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586917120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271727.608057:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788271727.608128:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f7bcea00 x1875138586917120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271727.608140:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586917120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788271728.628074:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271728.692649:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5ae6258-8c0a-484f-8e0e-8fd260991b76 00000020:00000080:3.0:1788271728.692659:0:6722:0:(genops.c:885:class_export_put()) final put ffff8ab6ee0eb000/d5ae6258-8c0a-484f-8e0e-8fd260991b76 00000020:00000080:0.0:1788271728.692694:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ee0eb000/d5ae6258-8c0a-484f-8e0e-8fd260991b76 for lustre-OST0000 00000020:00000080:0.0:1788271728.692754:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6ee0ed000 for lustre-OST0000 00010000:00010000:0.0:1788271729.651026:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271730.284516:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271730.284694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301312 00000100:00100000:0.0:1788271730.284705:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301312 00000100:00100000:0.0:1788271730.284791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:0.0:1788271730.284804:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574301312:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271730.284886:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574301312:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271730.284894:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00080000:2.0:1788271730.285167:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271730.293960:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271730.294004:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271730.294045:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301184 00000100:00100000:1.0:1788271730.294055:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301184 00000100:00100000:1.0:1788271730.294100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:1.0:1788271730.294110:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574301184:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271730.294190:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574301184:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271730.294198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:3.0:1788271730.295504:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301440 00000100:00100000:3.0:1788271730.295528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301440 00000100:00100000:3.0:1788271730.295614:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:3.0:1788271730.295636:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574301440:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271730.295709:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574301440:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 85us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271730.295716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00080000:0.0:1788271730.296104:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788271730.405372:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6386bcf0 20000000:00000080:0.0:1788271730.405390:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab6cc1a3800 uarg=0000000000000000 20000000:01000000:0.0:1788271730.405865:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788271730.405873:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788271730.405877:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788271730.406826:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788271730.406997:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788271730.411855:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788271730.411902:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.411924:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.411933:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.411940:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.411947:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.411953:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.411959:0:11168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.412001:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.412017:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 12 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.412032:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917248:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271730.412233:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.412254:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 18 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.412264:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917376:0@lo:104: 00000100:00100000:0.0:1788271730.412310:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271730.412344:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.412350:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 18 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.412355:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917504:0@lo:104: 00000100:00100000:0.0:1788271730.412368:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271730.412391:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.412397:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 18 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.412405:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917632:0@lo:104: 00000100:00100000:0.0:1788271730.412455:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271730.412493:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.412501:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 12 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.412509:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917760:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271730.412536:0:11168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271730.412719:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586917376 00000100:00100000:1.0:1788271730.412726:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586917376 00000100:00100000:1.0:1788271730.412765:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586917504 00000100:00100000:1.0:1788271730.412768:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586917504 00000100:00100000:1.0:1788271730.412778:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586917632 00000100:00100000:1.0:1788271730.412780:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586917632 00000100:00100000:1.0:1788271730.412796:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271730.412805:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:11168:x1875138586917376:12345-0@lo:104: 00010000:00010000:1.0:1788271730.412817:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.412882:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271730.412888:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:11168:x1875138586917376:12345-0@lo:104: Request processed in 85us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271730.412895:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271730.412919:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271730.412925:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:11168:x1875138586917504:12345-0@lo:104: 00010000:00010000:1.0:1788271730.412933:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.412968:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271730.412973:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:11168:x1875138586917504:12345-0@lo:104: Request processed in 48us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271730.412979:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271730.412990:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271730.412996:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:11168:x1875138586917632:12345-0@lo:104: 00010000:00010000:1.0:1788271730.413003:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413028:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788271730.413032:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:11168:x1875138586917632:12345-0@lo:104: Request processed in 37us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271730.413038:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788271730.413277:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788271730.413284:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413291:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271730.413295:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413303:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271730.413320:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271730.413326:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788271730.413355:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413361:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271730.413377:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413384:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19600/0xbeb05ca97b5f7256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f725d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413397:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271730.413400:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413405:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271730.413408:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413450:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271730.413456:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271730.413461:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788271730.413490:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413495:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271730.413509:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413515:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f7248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f724f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413523:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271730.413526:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413531:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b800 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271730.413533:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413539:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271730.413545:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271730.413550:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788271730.413679:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413686:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271730.413693:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413709:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab70024b800/0xbeb05ca97b5f723a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f7241 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413722:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271730.413723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271730.413725:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271730.413733:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271730.413745:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586917888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271730.413773:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271730.413803:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586918144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271730.413825:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271730.413840:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271730.413843:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586918016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271730.413857:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271730.413875:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586917888 00000100:00100000:1.0:1788271730.413878:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586917888 00010000:00010000:1.0:1788271730.413892:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 19 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271730.413904:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918144 00000100:00100000:1.0:1788271730.413905:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918144 00010000:00010000:1.0:1788271730.413911:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 20 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271730.413916:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918016 00000100:00100000:1.0:1788271730.413917:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918016 00010000:00010000:1.0:1788271730.413922:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 21 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271730.413938:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271730.413942:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+21:3279:x1875138586917888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271730.413950:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271730.413953:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 21 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413959:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 21 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.413971:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271730.413991:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+21:3279:x1875138586917888:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271730.413995:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271730.414020:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788271730.414024:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3281:x1875138586918144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271730.414028:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271730.414030:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 20 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.414035:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 20 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.414041:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271730.414055:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3281:x1875138586918144:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271730.414059:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788271730.414065:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788271730.414075:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586918016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271730.414080:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271730.414082:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 19 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.414088:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 19 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.414095:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271730.414116:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586918016:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271730.414121:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788271730.414166:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586917888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271730.414191:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586918016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271730.414198:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586918144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271730.416107:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f725d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f7256 expref: 18 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.416126:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917376:0@lo:104: 00010000:00010000:0.0:1788271730.416149:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f724f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f7248 expref: 17 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.416157:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917504:0@lo:104: 00010000:00010000:0.0:1788271730.416168:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f7241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f723a expref: 16 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.416175:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917632:0@lo:104: 00000100:00100000:0.0:1788271730.420524:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271730.420575:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271730.420608:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301568 00000100:00100000:0.0:1788271730.420616:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301568 00010000:00010000:0.0:1788271730.420654:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 13 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271730.420686:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301696 00000100:00100000:0.0:1788271730.420689:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301696 00010000:00010000:0.0:1788271730.420701:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 14 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271730.420709:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:3.0:1788271730.420720:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:248429c1-4bc1-48f2-96f4-7358aba5f110+14:2354:x1875138574301568:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271730.420734:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271730.420741:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 14 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271730.420754:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 14 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271730.420773:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271730.420795:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f7272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237e2 expref: 14 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271730.420809:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917248:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271730.420818:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875138586917760:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271730.420830:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574301568:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 114us (317us total) trans 0 rc 0/0 00010000:00010000:1.0:1788271730.420853:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271730.423749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:0.0:1788271730.423776:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:0.0:1788271730.423793:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574301696:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271730.423812:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271730.423821:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 13 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423847:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 12 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423868:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0031600/0xbeb05ca97b5f7233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x7693264610237aa expref: 12 pid: 5831 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423883:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423890:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423904:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423914:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423921:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423926:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423932:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0030e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271730.423936:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423943:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423971:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271730.423982:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271730.424028:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:2354:x1875138574301696:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 243us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271730.424034:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00010000:00010000:2.0:1788271730.424078:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271730.424086:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271730.424100:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f728e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271730.674631:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271731.704716:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271731.755938:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271731.756221:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301824 00000100:00100000:0.0:1788271731.756234:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301824 00000100:00100000:0.0:1788271731.756321:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 229 00000100:00100000:0.0:1788271731.756334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:5596:x1875138574301824:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271731.756360:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271731.756388:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76932646102380c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271731.756489:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271731.756503:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271731.756514:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0030e00, rc 0) 00000100:00100000:0.0:1788271731.756585:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574301824:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 253us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271731.757921:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 229 00000100:00100000:0.0:1788271731.761092:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271731.766381:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574301952 00000100:00100000:1.0:1788271731.766403:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574301952 00000100:00100000:0.0:1788271731.769978:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 230 00000100:00100000:0.0:1788271731.770001:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574301952:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271731.770489:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574301952:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 494us (9409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271731.770500:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 230 00000100:00100000:0.0:1788271731.779298:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271731.779479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302080 00000100:00100000:1.0:1788271731.779509:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302080 00000100:00100000:1.0:1788271731.779598:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 231 00000100:00100000:1.0:1788271731.779611:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574302080:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271731.779915:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574302080:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 304us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271731.779924:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 231 00000100:00100000:3.0:1788271731.784409:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271731.784512:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302208 00000100:00100000:0.0:1788271731.784531:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302208 00000100:00100000:0.0:1788271731.786765:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 232 00000100:00100000:0.0:1788271731.786797:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574302208:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271731.786821:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271731.786847:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023813 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271731.786885:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271731.786897:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271731.786909:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c0031c00, rc 0) 00000100:00100000:0.0:1788271731.787002:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574302208:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 221us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271731.787010:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 232 00000100:00100000:0.0:1788271731.792297:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271731.792404:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302336 00000100:00100000:1.0:1788271731.792448:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302336 00000100:00100000:1.0:1788271731.792518:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 233 00000100:00100000:1.0:1788271731.792530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574302336:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271731.792820:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574302336:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 291us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271731.792827:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 233 00000100:00100000:3.0:1788271731.794677:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271731.794784:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302464 00000100:00100000:0.0:1788271731.794801:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302464 00000100:00100000:0.0:1788271731.794888:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 234 00000100:00100000:0.0:1788271731.794902:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574302464:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271731.795339:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574302464:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 439us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271731.795349:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 234 10000000:01000000:0.0:1788271732.018830:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271732.018842:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6ee935800 from 7 10000000:01000000:0.0:1788271732.018848:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271732.018936:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.018951:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.018967:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271732.019001:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.019096:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271732.019173:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6cb7523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271732.019769:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918272 00000100:00100000:1.0:1788271732.019780:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918272 00000100:00100000:1.0:1788271732.019853:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788271732.019867:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586918272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271732.019887:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271732.019905:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f72a3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.019935:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.019947:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.019976:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6800, rc 0) 00000100:00100000:1.0:1788271732.020036:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586918272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.020044:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788271732.020486:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271732.020509:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.020521:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271732.021120:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.021218:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271732.021281:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6cb7523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271732.025337:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918400 00000100:00100000:1.0:1788271732.025359:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918400 00000100:00100000:1.0:1788271732.025467:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788271732.025483:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586918400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271732.025912:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586918400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 432us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.025921:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788271732.026298:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.026377:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.026469:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271732.026520:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6cb7523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271732.026740:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918528 00000100:00100000:1.0:1788271732.026746:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918528 00000100:00100000:0.0:1788271732.034152:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788271732.034185:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586918528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.034730:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586918528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 558us (8259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271732.034740:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788271732.035830:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788271732.038153:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788271732.045220:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788271732.045287:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271732.045303:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.045320:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271732.045333:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271732.045336:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c914a800 from 7 10000000:01000000:0.0:1788271732.045339:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271732.045398:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.045407:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.045469:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271732.045520:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca628e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.045812:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271732.045879:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271732.045941:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918656 00000100:00100000:1.0:1788271732.045952:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918656 00000100:00100000:1.0:1788271732.046023:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788271732.046036:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586918656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271732.046053:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271732.046069:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f72b1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.046097:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.046134:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.046145:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7800, rc 0) 00000100:00100000:1.0:1788271732.046211:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586918656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.046220:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788271732.046270:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca628e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271732.046295:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271732.046304:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271732.046408:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271732.046832:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271732.046878:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff370540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271732.046976:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918784 00000100:00100000:0.0:1788271732.046982:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918784 00000100:00100000:0.0:1788271732.047035:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788271732.047045:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586918784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.047303:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586918784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271732.047310:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788271732.047683:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271732.047720:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271732.047763:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271732.047793:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff370540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271732.047831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586918912 00000100:00100000:0.0:1788271732.047836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586918912 00000100:00100000:0.0:1788271732.047869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788271732.047877:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586918912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.048214:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586918912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271732.048223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788271732.048659:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586918912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788271732.049777:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788271732.049980:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788271732.050076:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271732.050088:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.050100:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271732.050132:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271732.050134:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c9170000 from 7 10000000:01000000:0.0:1788271732.050137:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271732.050176:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.050184:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271732.050194:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271732.050215:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586919040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.050270:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271732.050317:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271732.050341:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919040 00000100:00100000:1.0:1788271732.050352:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919040 00000100:00100000:1.0:1788271732.050693:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788271732.050710:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586919040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271732.050730:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271732.050750:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f72bf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.050783:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.050796:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271732.050808:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7a00, rc 0) 00000100:00100000:1.0:1788271732.050894:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586919040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.050902:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788271732.051170:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586919040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271732.051193:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271732.051204:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271732.051282:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586919168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271732.051324:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271732.051360:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271732.051484:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919168 00000100:00100000:1.0:1788271732.051769:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919168 00000100:00100000:0.0:1788271732.052098:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788271732.052124:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586919168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271732.052404:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586919168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271732.052459:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788271732.054690:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586919168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271732.054744:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586919296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271732.054803:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271732.054849:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271732.054878:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919296 00000100:00100000:1.0:1788271732.054893:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919296 00000100:00100000:1.0:1788271732.054967:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788271732.054980:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586919296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271732.055304:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586919296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.055314:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788271732.055333:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586919296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788271732.057484:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788271732.060178:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788271732.060230:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271732.060245:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271732.060262:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271732.722871:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586919424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271732.722957:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271732.723032:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919424 00000100:00100000:3.0:1788271732.723039:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919424 00000100:00100000:3.0:1788271732.723092:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788271732.723515:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586919424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271732.723551:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271732.723592:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586919424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271732.723606:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788271732.723693:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271732.723706:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586919552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271732.723733:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788271732.723786:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f7bcdf80 x1875138586919424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271732.723803:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586919424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788271732.724019:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271732.724245:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586919808:0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724286:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271732.724309:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271732.724315:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586919680:0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724338:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271732.724364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919808 00000100:00100000:3.0:1788271732.724369:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919808 00000100:00100000:3.0:1788271732.724402:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919680 00000100:00100000:3.0:1788271732.724406:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919680 00000100:00100000:3.0:1788271732.724574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788271732.724583:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586919808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724636:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586919808:12345-0@lo:400:kworker.0 Request processed in 54us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271732.724643:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788271732.724656:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788271732.724662:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586919680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724688:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586919680:12345-0@lo:400:kworker.0 Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271732.724705:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788271732.724724:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271732.724739:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271732.724746:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586919936:0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724770:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271732.724800:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586919680:0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724809:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586919808:0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724823:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919936 00000100:00100000:3.0:1788271732.724826:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919936 00000100:00100000:3.0:1788271732.724850:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788271732.724855:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586919936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271732.724886:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586919936:12345-0@lo:400:kworker.0 Request processed in 30us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271732.724892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788271732.724905:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271732.724919:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586919936:0@lo:400:kworker.0 00000100:00100000:0.0:1788271732.725203:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586919552 00000100:00100000:0.0:1788271732.725208:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586919552 00000100:00100000:0.0:1788271732.725236:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271732.725242:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586919552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271732.725263:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271732.725310:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586919552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271732.725326:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788271732.725699:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271732.725723:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cab9ad80 x1875138586919552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271732.725740:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586919552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788271733.747604:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788271734.654856:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788271734.780868:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271735.413011:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271735.413071:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271735.413089:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302592 00000100:00100000:0.0:1788271735.413099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302592 00000100:00100000:3.0:1788271735.413106:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271735.413145:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 244 00000100:00100000:0.0:1788271735.413156:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574302592:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271735.413198:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302848 00000100:00100000:2.0:1788271735.413203:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302848 00000100:00100000:0.0:1788271735.413224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574302592:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271735.413232:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 244 00000100:00100000:2.0:1788271735.413243:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302720 00000100:00100000:2.0:1788271735.413246:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302720 00000100:00100000:2.0:1788271735.413267:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00080000:3.0:1788271735.413304:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271735.413486:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574302848:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271735.413525:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574302848:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 251us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271735.415143:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:1.0:1788271735.415166:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574302720:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271735.415219:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574302720:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 64us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271735.415228:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:2.0:1788271735.416236:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 91 00010000:00010000:2.0:1788271735.795090:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271736.819646:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271737.842792:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271737.842969:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271737.843016:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586920064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271737.843084:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271737.843170:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920064 00000100:00100000:3.0:1788271737.843178:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920064 00000100:00100000:3.0:1788271737.843232:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788271737.843241:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586920064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271737.843276:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271737.843329:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586920064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271737.843336:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788271737.843367:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788271737.843394:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f7bcdf80 x1875138586920064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271737.843440:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586920064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271737.843645:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586920320:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.843677:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271737.843703:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788271737.843708:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586920192:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.843748:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271737.843769:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586920704:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.843790:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271737.843815:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920320 00000100:00100000:2.0:1788271737.843818:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920320 00000100:00100000:2.0:1788271737.843843:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920704 00000100:00100000:2.0:1788271737.843846:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920704 00000100:00100000:2.0:1788271737.843866:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788271737.843872:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586920320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.843905:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586920320:12345-0@lo:400:kworker.0 Request processed in 33us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271737.843910:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788271737.843924:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788271737.843929:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586920704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.843951:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586920704:12345-0@lo:400:kworker.0 Request processed in 22us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271737.843957:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788271737.843975:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271737.843990:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586920704:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.843998:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586920320:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.844029:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586920448:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.844049:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271737.844064:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271737.844068:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586920576:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.844088:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271737.844119:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920576 00000100:00100000:2.0:1788271737.844122:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920576 00000100:00100000:2.0:1788271737.844148:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271737.844154:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586920576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.844184:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586920576:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271737.844190:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788271737.844202:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271737.844208:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920448 00000100:00100000:2.0:1788271737.844210:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920448 00000100:00100000:2.0:1788271737.844232:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788271737.844237:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586920448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.844262:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586920448:12345-0@lo:400:kworker.0 Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271737.844267:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788271737.844282:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788271737.844298:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6edf2a680 x1875138586920576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271737.844308:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586920576:0@lo:400:kworker.0 00000100:00100000:2.0:1788271737.844317:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586920448:0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.844533:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920192 00000100:00100000:1.0:1788271737.844537:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920192 00000100:00100000:1.0:1788271737.844560:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788271737.844565:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586920192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.844596:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586920192:12345-0@lo:400:kworker.0 Request processed in 31us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271737.844601:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788271737.845149:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586920832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271737.845184:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271737.845230:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586920192:0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.845873:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920832 00000100:00100000:0.0:1788271737.845880:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920832 00000100:00100000:0.0:1788271737.845923:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271737.845932:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586920832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271737.845965:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271737.846028:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586920832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271737.846034:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788271737.846241:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cab9b480 x1875138586920832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271737.846286:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586920832:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788271738.531068:0:11465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:08:56 (1788271736) === 00000100:00100000:3.0:1788271738.699173:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271738.699217:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271738.699336:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574302976 00000100:00100000:2.0:1788271738.699346:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574302976 00000100:00100000:2.0:1788271738.699445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:2.0:1788271738.699456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574302976:12345-192.168.201.1@tcp:41:mkdir.0 00000004:00000024:2.0:1788271738.699505:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788271738.699595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574302976:12345-192.168.201.1@tcp:41:mkdir.0 Request processed in 141us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271738.699603:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00080000:3.0:1788271738.700020:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271738.700106:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574303104 00000100:00100000:1.0:1788271738.700120:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574303104 00000100:00100000:1.0:1788271738.705133:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1788271738.705154:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:9708:x1875138574303104:12345-192.168.201.1@tcp:700:mkdir.0 00000100:00100000:1.0:1788271738.705257:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:9708:x1875138574303104:12345-192.168.201.1@tcp:700:mkdir.0 Request processed in 110us (6038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271738.705265:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1788271738.706802:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271738.706862:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574303360 00000100:00100000:0.0:1788271738.706872:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574303360 00000100:00100000:0.0:1788271738.706952:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1788271738.706964:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:9708:x1875138574303360:12345-192.168.201.1@tcp:36:mkdir.0 00010000:00010000:0.0:1788271738.707026:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271738.707104:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f71ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023795 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.707124:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64a00) 00010000:00010000:0.0:1788271738.707135:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271738.707490:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.707504:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.707514:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.707543:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.707550:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.707557:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271738.708795:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788271738.708810:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.708819:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.708826:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.708833:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271738.708838:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.708845:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.708867:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271738.708870:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271738.708874:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.708880:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f72cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271738.708912:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b925befe reply state 000000007e33aece transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271738.708923:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271738.709060:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:9708:x1875138574303360:12345-192.168.201.1@tcp:36:mkdir.0 Request processed in 2094us (2262us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788271738.709070:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00010000:00010000:0.0:1788271738.712269:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.712287:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.712295:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.712301:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271738.712306:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.712314:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.712346:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab6c2fd1500) 00010000:00010000:0.0:1788271738.712349:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271738.712354:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.712361:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f72d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271738.721636:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271738.721942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574303488 00000100:00100000:2.0:1788271738.721953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574303488 00000100:00100000:2.0:1788271738.722027:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:2.0:1788271738.722039:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:9709:x1875138574303488:12345-192.168.201.1@tcp:101:chmod.0 00010000:00010000:2.0:1788271738.722062:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271738.722084:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f72db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102381a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.722155:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f72e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.722168:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f72e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.722179:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f72e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271738.722245:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788271738.722262:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271738.722309:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f72e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.722337:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f72db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102381a expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.722356:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f72e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102381a expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.722365:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64200) 00010000:00010000:2.0:1788271738.722369:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271738.722373:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024be00, rc 0) 00000100:00100000:2.0:1788271738.722465:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:9709:x1875138574303488:12345-192.168.201.1@tcp:101:chmod.0 Request processed in 428us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271738.722473:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1788271738.731126:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271738.733384:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574303744 00000100:00100000:3.0:1788271738.733399:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574303744 00000100:00100000:3.0:1788271738.733500:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:3.0:1788271738.733512:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:9709:x1875138574303744:12345-192.168.201.1@tcp:36:chmod.0 00010000:00010000:3.0:1788271738.733570:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271738.733604:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f72e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102381a expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.733646:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64200) 00010000:00010000:3.0:1788271738.733657:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271738.733685:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.733699:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.733709:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271738.734041:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065047e45 reply state 0000000091dcecc9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271738.734052:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788271738.734066:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788271738.734167:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:9709:x1875138574303744:12345-192.168.201.1@tcp:36:chmod.0 Request processed in 657us (3052us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788271738.734175:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00010000:00010000:0.0:1788271738.741032:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.741052:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.741060:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.741067:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271738.741072:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.741080:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.741098:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c3e3ca00) 00010000:00010000:0.0:1788271738.741101:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788271738.741106:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.741111:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f72e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271738.753652:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271738.753756:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574303872 00000100:00100000:2.0:1788271738.753766:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574303872 00000100:00100000:2.0:1788271738.753815:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1788271738.753825:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:9710:x1875138574303872:12345-192.168.201.1@tcp:101:chown.0 00010000:00010000:2.0:1788271738.753849:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271738.753872:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f72f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023821 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.753936:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f72f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.753951:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f72f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.753980:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f72f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271738.754056:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788271738.754060:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271738.754100:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f72f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.754125:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f72f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023821 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.754145:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f72f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023821 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.754153:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64b00) 00010000:00010000:2.0:1788271738.754157:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271738.754161:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ac00, rc 0) 00000100:00100000:2.0:1788271738.754224:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:9710:x1875138574303872:12345-192.168.201.1@tcp:101:chown.0 Request processed in 399us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271738.754231:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1788271738.760362:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271738.760727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574304000 00000100:00100000:3.0:1788271738.760744:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574304000 00000100:00100000:3.0:1788271738.760822:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1788271738.760837:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:9710:x1875138574304000:12345-192.168.201.1@tcp:101:chown.0 00010000:00010000:3.0:1788271738.760866:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271738.760893:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f72fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023828 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.760976:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761065:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761079:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761100:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761107:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761114:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761240:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7313 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761249:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761255:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271738.761299:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788271738.761303:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271738.761332:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761447:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761465:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761472:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761479:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271738.761484:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761492:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761505:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64b00) 00010000:00010000:3.0:1788271738.761509:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271738.761514:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761521:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f7305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761547:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761555:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761561:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761566:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271738.761576:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761583:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761592:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab6c3e3c600) 00010000:00010000:3.0:1788271738.761595:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271738.761598:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761604:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f730c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761639:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f72fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023828 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761654:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7313 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023828 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.761661:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c3e3c900) 00010000:00010000:3.0:1788271738.761664:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271738.761667:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18800, rc 0) 00000100:00100000:3.0:1788271738.761758:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:9710:x1875138574304000:12345-192.168.201.1@tcp:101:chown.0 Request processed in 925us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271738.761768:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1788271738.771642:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271738.772467:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574304256 00000100:00100000:0.0:1788271738.772479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574304256 00000100:00100000:0.0:1788271738.772546:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:0.0:1788271738.772558:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:9710:x1875138574304256:12345-192.168.201.1@tcp:36:chown.0 00010000:00010000:0.0:1788271738.772612:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271738.772639:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7313 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023828 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.772659:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c3e3c900) 00010000:00010000:0.0:1788271738.772667:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271738.772692:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.772704:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.772713:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271738.833241:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788271738.833602:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd814840 reply state 00000000896867f3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271738.833617:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788271738.833772:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1788271738.833923:0:5837:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788271738.833948:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:9710:x1875138574304256:12345-192.168.201.1@tcp:36:chown.0 Request processed in 61388us (62317us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788271738.833958:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00010000:00010000:2.0:1788271738.834060:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.834070:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.834078:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.834096:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271738.834101:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.834109:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.834127:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1500) 00010000:00010000:2.0:1788271738.834130:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788271738.834134:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.834140:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f731a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271738.867150:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271738.870287:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271738.871062:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574304384 00000100:00100000:2.0:1788271738.871072:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574304384 00000100:00100000:2.0:1788271738.871137:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:2.0:1788271738.871148:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:9711:x1875138574304384:12345-192.168.201.1@tcp:101:touch.500 00010000:00010000:2.0:1788271738.871170:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271738.871189:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102382f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271738.872498:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1259us 00010000:00010000:0.0:1788271738.906814:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.906861:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.906877:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.906900:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.906908:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.906916:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.907719:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc000/0xbeb05ca97b5f7336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.907732:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc000/0xbeb05ca97b5f7336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.907742:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc000/0xbeb05ca97b5f7336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271738.907883:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788271738.907888:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788271738.908016:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc000/0xbeb05ca97b5f7336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908033:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908050:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908058:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908064:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271738.908070:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908078:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908092:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64b00) 00010000:00010000:0.0:1788271738.908095:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271738.908101:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908108:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd600/0xbeb05ca97b5f7328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908123:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908129:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908135:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908141:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fca00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271738.908149:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908156:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908165:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271738.908168:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271738.908170:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908176:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f732f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908239:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102382f expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908256:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc000/0xbeb05ca97b5f7336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102382f expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.908263:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:0.0:1788271738.908265:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788271738.908268:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c13fc000, rc 0) 00000100:00100000:0.0:1788271738.908357:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:9711:x1875138574304384:12345-192.168.201.1@tcp:101:touch.500 Request processed in 37208us (38078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271738.908368:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1788271738.915230:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271738.915321:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574304640 00000100:00100000:0.0:1788271738.915339:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574304640 00000100:00100000:0.0:1788271738.915470:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:0.0:1788271738.915484:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:9711:x1875138574304640:12345-192.168.201.1@tcp:101:touch.500 00010000:00010000:0.0:1788271738.915532:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271738.915574:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f733d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023836 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.915937:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.915952:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.915962:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.917953:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.917977:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.918000:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271738.919171:0:8302:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788271738.919462:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f7352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919475:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f7352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919486:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f7352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919535:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919542:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919549:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919555:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271738.919560:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919567:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919580:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:0.0:1788271738.919583:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271738.919587:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919593:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f7344 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271738.919607:0:8302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000887bdc5d reply state 0000000020936ac7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271738.919616:0:8302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788271738.919656:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f733d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023836 expref: 10 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919895:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f7352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023836 expref: 9 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.919908:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6c2fd1e00) 00010000:00010000:0.0:1788271738.919910:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271738.919914:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375600, rc 0) 00000100:00100000:0.0:1788271738.919995:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:9711:x1875138574304640:12345-192.168.201.1@tcp:101:touch.500 Request processed in 4504us (4765us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788271738.920004:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00010000:00010000:2.0:1788271738.922306:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.922324:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.922333:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.922355:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271738.922360:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.922368:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.922385:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4304ee36 (ffff8ab6c2fd1c00) 00010000:00010000:2.0:1788271738.922388:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271738.922394:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271738.922400:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f734b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271738.923407:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271738.923590:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574304896 00000100:00100000:3.0:1788271738.923604:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574304896 00000100:00100000:3.0:1788271738.923706:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:3.0:1788271738.923718:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:9711:x1875138574304896:12345-192.168.201.1@tcp:36:touch.500 00010000:00010000:3.0:1788271738.923802:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271738.923833:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f7352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023836 expref: 9 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.923852:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6c2fd1e00) 00010000:00010000:3.0:1788271738.923863:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271738.923917:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.923931:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271738.923942:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271738.924120:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013a46990 reply state 00000000f201f1bf transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271738.924131:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271738.924241:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:9711:x1875138574304896:12345-192.168.201.1@tcp:36:touch.500 Request processed in 525us (846us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788271738.924249:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00010000:00010000:0.0:1788271738.928647:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.928671:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.928679:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.928685:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271738.928691:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.928700:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.928722:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:0.0:1788271738.929259:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271738.929269:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.929301:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7360 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271738.932688:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271738.933156:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574305024 00000100:00100000:0.0:1788271738.933170:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574305024 00000100:00100000:0.0:1788271738.933307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:0.0:1788271738.933320:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:9711:x1875138574305024:12345-192.168.201.1@tcp:101:touch.500 00010000:00010000:0.0:1788271738.933474:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271738.933623:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7367 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102383d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.933710:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102383d expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.933803:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102383d expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271738.933832:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271738.933836:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271738.933841:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375400, rc 0) 00000100:00100000:0.0:1788271738.933925:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:9711:x1875138574305024:12345-192.168.201.1@tcp:101:touch.500 Request processed in 608us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271738.933934:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:1.0:1788271738.936837:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271738.937546:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574305152 00000100:00100000:2.0:1788271738.937562:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574305152 00000100:00100000:2.0:1788271738.937628:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:2.0:1788271738.937639:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fee62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875138574305152:12345-192.168.201.1@tcp:8:touch.500 00010000:00080000:2.0:1788271738.937679:0:8463:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1788271738.937722:0:8463:0:(genops.c:1385:class_connect()) connect: client 896349b1-dd1e-47e2-bcd1-0ecd5d75458e, cookie 0xbeb05ca97b5f736e 00002000:00100000:2.0:1788271738.937737:0:8463:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 896349b1-dd1e-47e2-bcd1-0ecd5d75458e/ffff8ab6fee16800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788271738.937751:0:8463:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788271738.938060:0:8463:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788271738.938102:0:8463:0:(import.c:65:import_set_state_nolock()) ffff8ab6fee10800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271738.938456:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fee62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2350:x1875138574305152:12345-192.168.201.1@tcp:8:touch.500 Request processed in 815us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271738.938485:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1788271738.943186:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271738.943680:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574305280 00000100:00100000:2.0:1788271738.943694:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574305280 00000100:00100000:2.0:1788271738.943902:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:2.0:1788271738.943917:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:0:x1875138574305280:12345-192.168.201.1@tcp:2:touch.500 00000100:00080000:3.0:1788271738.945152:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271739.002484:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:0:x1875138574305280:12345-192.168.201.1@tcp:2:touch.500 Request processed in 58555us (59292us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788271739.002500:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000001:00080000:3.0:1788271739.004077:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1788271739.004103:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000100:00100000:2.0:1788271739.006123:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271739.007103:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574305536 00000100:00100000:1.0:1788271739.007120:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574305536 00000100:00100000:1.0:1788271739.007195:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:1.0:1788271739.007207:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:9711:x1875138574305536:12345-192.168.201.1@tcp:35:touch.500 00000100:00100000:1.0:1788271739.007940:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:9711:x1875138574305536:12345-192.168.201.1@tcp:35:touch.500 Request processed in 731us (1824us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788271739.007951:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:2.0:1788271739.027887:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271739.028027:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574305664 00000100:00100000:3.0:1788271739.028058:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574305664 00000100:00100000:3.0:1788271739.028171:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:3.0:1788271739.028184:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:9712:x1875138574305664:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:3.0:1788271739.028215:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271739.028242:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023844 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.028346:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f737c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.028363:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f737c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.028377:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f737c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271739.028507:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788271739.028512:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271739.028579:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f737c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.028612:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023844 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.028632:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f737c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023844 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.028642:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:3.0:1788271739.028645:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271739.028649:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18600, rc 0) 00000100:00100000:3.0:1788271739.028743:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:9712:x1875138574305664:12345-192.168.201.1@tcp:101:rm.0 Request processed in 561us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271739.028751:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:3.0:1788271739.033087:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271739.033200:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574305920 00000100:00100000:2.0:1788271739.033212:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574305920 00000100:00100000:2.0:1788271739.033286:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1788271739.033298:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:9712:x1875138574305920:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:2.0:1788271739.033335:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271739.033363:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102384b expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271739.033573:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788271739.034040:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7383 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102384b expref: 14 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.034060:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64b00) 00010000:00010000:2.0:1788271739.034064:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271739.034071:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x76932646102384b expref: 14 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.034087:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ba00, rc 0) 00000100:00100000:2.0:1788271739.034214:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:9712:x1875138574305920:12345-192.168.201.1@tcp:101:rm.0 Request processed in 917us (1141us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788271739.034231:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1788271739.040790:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271739.040964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574306048 00000100:00100000:3.0:1788271739.040978:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574306048 00000100:00100000:3.0:1788271739.041060:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1788271739.041073:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:9712:x1875138574306048:12345-192.168.201.1@tcp:37:rm.0 00000100:00100000:3.0:1788271739.046578:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:9712:x1875138574306048:12345-192.168.201.1@tcp:37:rm.0 Request processed in 5490us (5786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271739.046769:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:0.0:1788271739.053943:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271739.054647:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574306304 00000100:00100000:1.0:1788271739.054660:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574306304 00000100:00100000:1.0:1788271739.054788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:1.0:1788271739.054801:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:9712:x1875138574306304:12345-192.168.201.1@tcp:35:rm.0 00000100:00100000:1.0:1788271739.055218:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:9712:x1875138574306304:12345-192.168.201.1@tcp:35:rm.0 Request processed in 419us (1288us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788271739.055227:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:2.0:1788271739.058706:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271739.058918:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574306560 00000100:00100000:0.0:1788271739.058929:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574306560 00000100:00100000:0.0:1788271739.059012:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:0.0:1788271739.059026:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:9712:x1875138574306560:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:0.0:1788271739.059058:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271739.059088:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023852 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.059326:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f7398 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.059882:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f7398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.059897:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f7398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271739.059914:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788271739.060210:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023852 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.060234:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f7398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023852 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.060243:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:2.0:1788271739.060246:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271739.060250:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374c00, rc 0) 00000100:00100000:2.0:1788271739.060371:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:9712:x1875138574306560:12345-192.168.201.1@tcp:101:rm.0 Request processed in 1347us (1677us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788271739.060381:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:2.0:1788271739.068482:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271739.068560:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574306688 00000100:00100000:0.0:1788271739.068575:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574306688 00000100:00100000:0.0:1788271739.068736:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:0.0:1788271739.068750:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:9712:x1875138574306688:12345-192.168.201.1@tcp:41:rm.0 00000004:00000024:0.0:1788271739.068832:0:8302:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788271739.068944:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:9712:x1875138574306688:12345-192.168.201.1@tcp:41:rm.0 Request processed in 194us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271739.068953:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:1.0:1788271739.073187:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271739.073398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574306816 00000100:00100000:3.0:1788271739.073447:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574306816 00000100:00100000:2.0:1788271739.073714:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1788271739.073735:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:9712:x1875138574306816:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:2.0:1788271739.073763:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271739.075064:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f73a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023859 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075197:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075216:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075252:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075275:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075282:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075290:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075687:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f73bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075699:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f73bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075706:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f73bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271739.075750:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788271739.075755:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271739.075777:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f73bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075790:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f73bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075799:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075817:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075825:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075833:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024bc00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271739.075839:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075847:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075861:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:2.0:1788271739.075864:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271739.075870:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075876:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f73ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075889:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075895:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075902:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075906:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271739.075928:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075935:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075943:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4304ee36 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271739.075946:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271739.075948:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.075954:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f73b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.076005:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f73a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023859 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.076022:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f73bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023859 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.076029:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271739.076032:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271739.076035:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a800, rc 0) 00000100:00100000:2.0:1788271739.076243:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+17:9712:x1875138574306816:12345-192.168.201.1@tcp:101:rm.0 Request processed in 2513us (3064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271739.076264:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1788271739.081312:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271739.081775:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574307072 00000100:00100000:1.0:1788271739.081789:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574307072 00000100:00100000:1.0:1788271739.081937:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:1.0:1788271739.081950:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+17:9712:x1875138574307072:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:1.0:1788271739.082034:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788271739.082072:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f73bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023859 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082102:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7367 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x76932646102383d expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082116:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:1.0:1788271739.082137:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f737c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023844 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082148:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:1.0:1788271739.082152:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271739.082178:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082194:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082204:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082241:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082248:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.082254:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.083004:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.083017:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.083026:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271739.085214:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788271739.085234:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302266819844ns, next at 303266815864ns, rc = 0 00010000:00010000:1.0:1788271739.085347:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085366:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085380:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085391:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085459:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085466:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085485:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271739.085523:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085597:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085605:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085612:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271739.085617:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085626:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085640:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6cb419900) 00010000:00010000:1.0:1788271739.085644:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788271739.085648:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085654:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f73d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085677:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085690:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085696:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085701:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271739.085705:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085711:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085719:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:1.0:1788271739.085721:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271739.085724:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271739.085730:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6c00/0xbeb05ca97b5f73c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271739.085741:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000551aab38 reply state 000000006eb2e4d1 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271739.085752:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788271739.086001:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271739.086009:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.086023:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271739.086027:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.086034:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.086043:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab6cb419900) 00010000:00010000:0.0:1788271739.086046:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788271739.086049:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.086055:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7000/0xbeb05ca97b5f73d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271739.086071:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271739.086073:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271739.086075:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271739.086117:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:9712:x1875138574307072:12345-192.168.201.1@tcp:36:rm.0 Request processed in 4163us (4813us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788271739.086128:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00010000:00010000:2.0:1788271739.090167:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.090214:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.090223:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.090229:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271739.090236:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.090245:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.090267:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4304ee36 (ffff8ab6cb419000) 00010000:00010000:2.0:1788271739.090271:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271739.090277:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.090283:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6400/0xbeb05ca97b5f73c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271739.094407:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271739.094718:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574307328 00000100:00100000:1.0:1788271739.094731:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574307328 00000100:00100000:1.0:1788271739.094830:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:1.0:1788271739.094844:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:9712:x1875138574307328:12345-192.168.201.1@tcp:35:rm.0 00000100:00100000:1.0:1788271739.095208:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:9712:x1875138574307328:12345-192.168.201.1@tcp:35:rm.0 Request processed in 365us (827us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788271739.095217:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:1.0:1788271739.098935:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271739.099098:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574307584 00000100:00100000:3.0:1788271739.099110:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574307584 00000100:00100000:3.0:1788271739.099179:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:3.0:1788271739.099190:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:9712:x1875138574307584:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:3.0:1788271739.099264:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788271739.099298:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f7398 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023852 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099322:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc000/0xbeb05ca97b5f7336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102382f expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099348:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c2fd1700) 00010000:00010000:3.0:1788271739.099384:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f72f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023821 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099828:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64b00) 00010000:00010000:3.0:1788271739.099838:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271739.099871:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099887:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099897:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099909:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099916:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.099923:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.100312:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.100321:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.100342:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271739.101125:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788271739.101147:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101162:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101169:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101176:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271739.101182:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101191:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101204:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271739.101207:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788271739.101211:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101218:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19800/0xbeb05ca97b5f73ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101243:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101250:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101256:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101260:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271739.101270:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101276:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101285:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c3e3c000) 00010000:00010000:3.0:1788271739.101287:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271739.101290:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271739.101296:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f73de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271739.101308:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053d5f8c5 reply state 00000000c3b4de38 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271739.101318:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271739.101455:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:9712:x1875138574307584:12345-192.168.201.1@tcp:36:rm.0 Request processed in 2262us (2530us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788271739.101465:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00010000:00010000:2.0:1788271739.115693:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.115719:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.115729:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.115765:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271739.115772:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.115780:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.115816:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab6c3e3c700) 00010000:00010000:2.0:1788271739.115820:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271739.115826:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.115832:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f73e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271739.891822:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271740.541533:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271740.541593:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271740.541634:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271740.541669:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271740.541718:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574307712 00000100:00100000:1.0:1788271740.541731:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574307712 00000100:00100000:1.0:1788271740.541798:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 246 00000100:00100000:1.0:1788271740.541811:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574307712:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271740.541916:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574307712:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.541925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 246 00000100:00100000:1.0:1788271740.541977:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574307968 00000100:00100000:1.0:1788271740.541981:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574307968 00000100:00100000:1.0:1788271740.542026:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1788271740.542033:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574307968:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271740.542070:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574307968:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.542076:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:3.0:1788271740.542204:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574307840 00000100:00100000:3.0:1788271740.542210:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574307840 00000100:00100000:3.0:1788271740.542252:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308096 00000100:00100000:3.0:1788271740.542255:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308096 00000100:00100000:3.0:1788271740.542279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:3.0:1788271740.542286:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2351:x1875138574307840:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271740.542340:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2351:x1875138574307840:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 54us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271740.542347:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:2.0:1788271740.547995:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:2.0:1788271740.548035:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2351:x1875138574308096:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271740.548169:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2351:x1875138574308096:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 155us (6575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.548179:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00080000:1.0:1788271740.553777:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271740.553792:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788271740.914626:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271741.938660:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271742.458105:0:11614:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1788271742.963006:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271742.963039:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271742.963138:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788271742.963520:0:7002:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306145105043ns, next at 307145101939ns, rc = 0 00000100:00100000:2.0:1788271742.963539:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271742.963550:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586921088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271742.963586:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271742.963640:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586920960 00000100:00100000:2.0:1788271742.963649:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586920960 00000100:00100000:2.0:1788271742.963722:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921088 00000100:00100000:2.0:1788271742.963726:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921088 00000100:00100000:2.0:1788271742.963749:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788271742.963760:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586920960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271742.963808:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271742.963856:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586920960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271742.963863:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788271742.963886:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271742.963893:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586921088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271742.963929:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271742.963965:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586921088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271742.963972:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271742.964056:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586921344:0@lo:400:kworker.0 00000100:00100000:2.0:1788271742.964087:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271742.964110:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271742.964116:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586921216:0@lo:400:kworker.0 00000100:00100000:2.0:1788271742.964149:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271742.964189:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921344 00000100:00100000:2.0:1788271742.964193:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921344 00000100:00100000:2.0:1788271742.964226:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788271742.964234:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586921344:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788271742.964447:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271742.964453:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788271742.964565:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271742.964580:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921216 00000100:00100000:0.0:1788271742.964584:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921216 00000100:00100000:0.0:1788271742.964627:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788271742.964635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586921216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271742.964679:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586921216:12345-0@lo:400:kworker.0 Request processed in 45us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271742.964686:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788271742.964721:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586921472:0@lo:400:kworker.0 00000100:00100000:0.0:1788271742.964762:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788271742.964799:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6edf28700 x1875138586921088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271742.964823:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586921088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271742.964842:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271742.964848:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586921600:0@lo:400:kworker.0 00000100:00100000:0.0:1788271742.964872:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271742.964899:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921472 00000100:00100000:0.0:1788271742.964903:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921472 00000100:00100000:0.0:1788271742.964940:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921600 00000100:00100000:0.0:1788271742.964944:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921600 00000100:00100000:0.0:1788271742.964961:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788271742.964967:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586921472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271742.965004:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586921472:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271742.965011:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788271742.965024:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788271742.965030:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586921600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271742.965057:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586921600:12345-0@lo:400:kworker.0 Request processed in 28us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271742.965064:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1788271742.965093:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f7bcea00 x1875138586920960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271742.965108:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271742.965137:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586921600:0@lo:400:kworker.0 00000100:00100000:0.0:1788271742.965158:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586921472:0@lo:400:kworker.0 00000100:00100000:0.0:1788271742.965226:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586921216:0@lo:400:kworker.0 00000100:00080000:1.0:1788271742.965386:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271742.965474:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586921344:12345-0@lo:400:kworker.0 Request processed in 1240us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271742.965491:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788271742.965951:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586921344:0@lo:400:kworker.0 00000020:00000080:2.0:1788271743.398024:0:11662:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd43b95870 20000000:00000080:2.0:1788271743.398048:0:11662:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab6ff154000 uarg=0000000000000000 20000000:01000000:2.0:1788271743.398090:0:11662:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788271743.398097:0:11662:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788271743.398101:0:11662:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788271743.399523:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788271743.399814:0:11662:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788271743.406949:0:11662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788271743.407010:0:11662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788271743.407071:0:11662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788271743.407089:0:11662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788271743.407109:0:11662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407130:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407204:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407211:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407218:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407225:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407233:0:11662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407354:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407369:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 18 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271743.407384:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586921728:0@lo:104: 00000100:00100000:2.0:1788271743.407542:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271743.407609:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407619:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 18 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271743.407628:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586921856:0@lo:104: 00000100:00100000:2.0:1788271743.407651:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271743.407780:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.407789:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 18 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271743.407797:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586921984:0@lo:104: 00000100:00100000:2.0:1788271743.407821:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271743.415963:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.415988:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 12 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271743.416027:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc166300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586922112:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271743.416481:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.416492:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271743.416502:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586922240:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271743.416538:0:11662:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271743.423009:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921728 00000100:00100000:1.0:1788271743.423024:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921728 00000100:00100000:1.0:1788271743.423083:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921856 00000100:00100000:1.0:1788271743.423087:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921856 00000100:00100000:1.0:1788271743.423098:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586921984 00000100:00100000:1.0:1788271743.423100:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586921984 00000100:00100000:1.0:1788271743.423118:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271743.423127:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:11662:x1875138586921728:12345-0@lo:104: 00010000:00010000:1.0:1788271743.423208:0:8505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423374:0:8505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271743.423380:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+5:11662:x1875138586921728:12345-0@lo:104: Request processed in 255us (15839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.423388:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271743.423407:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788271743.423439:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:11662:x1875138586921856:12345-0@lo:104: 00010000:00010000:1.0:1788271743.423447:0:8505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423485:0:8505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271743.423492:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+4:11662:x1875138586921856:12345-0@lo:104: Request processed in 79us (15840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.423514:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788271743.423528:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788271743.423533:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:11662:x1875138586921984:12345-0@lo:104: 00010000:00010000:1.0:1788271743.423540:0:8505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423567:0:8505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788271743.423572:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+3:11662:x1875138586921984:12345-0@lo:104: Request processed in 40us (15750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.423578:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788271743.423621:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788271743.423627:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423635:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031600 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271743.423640:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423649:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271743.423656:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271743.423662:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788271743.423702:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423710:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271743.423737:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423745:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031600/0xbeb05ca97b5f72bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423758:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271743.423762:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423767:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031200 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271743.423770:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423776:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271743.423782:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271743.423786:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788271743.423799:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423804:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271743.423809:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423815:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031200/0xbeb05ca97b5f72b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423823:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271743.423832:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423838:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0030800 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271743.423841:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423847:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271743.423853:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271743.423858:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788271743.423870:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423875:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271743.423890:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423896:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030800/0xbeb05ca97b5f72a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f72aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.423920:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271743.423921:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271743.423923:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271743.424039:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271743.424383:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586922368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271743.424472:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586922624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271743.425538:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271743.425611:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586922496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271743.425644:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271743.426625:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586921728:0@lo:104: 00000100:00100000:2.0:1788271743.426640:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586921856:0@lo:104: 00000100:00100000:2.0:1788271743.426648:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586921984:0@lo:104: 00000100:00100000:3.0:1788271743.427473:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271743.427508:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271743.427701:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586922624 00000100:00100000:3.0:1788271743.427710:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586922624 00010000:00010000:3.0:1788271743.427747:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 19 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271743.427772:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586922496 00000100:00100000:3.0:1788271743.427775:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586922496 00010000:00010000:3.0:1788271743.427786:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 20 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271743.427796:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308224 00000100:00100000:3.0:1788271743.427798:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308224 00010000:00010000:3.0:1788271743.427806:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 13 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271743.427816:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308352 00000100:00100000:3.0:1788271743.427819:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308352 00010000:00010000:3.0:1788271743.427828:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 14 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271743.427840:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788271743.427848:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3278:x1875138586922624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271743.427861:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271743.427866:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 20 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271743.427876:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 20 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271743.427905:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f72aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f72a3 expref: 20 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271743.428319:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc166300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586922112:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271743.428330:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875138586922240:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271743.428362:0:11662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271743.428462:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788271743.428471:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+20:3281:x1875138586922496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271743.428482:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271743.428486:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 20 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428495:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 20 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428514:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee7800/0xbeb05ca97b5f72b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f72b1 expref: 20 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428528:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271743.428583:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586922496:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271743.428591:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788271743.428614:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:2.0:1788271743.428621:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+14:2354:x1875138574308224:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271743.428628:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271743.428633:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428653:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428664:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0031c00/0xbeb05ca97b5f729c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023813 expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428674:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271743.428714:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574308224:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 93us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271743.428720:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:2.0:1788271743.428734:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1788271743.428741:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+12:2354:x1875138574308352:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271743.428748:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271743.428758:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428766:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428774:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0030e00/0xbeb05ca97b5f7295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x76932646102380c expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271743.428783:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271743.428800:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248429c1-4bc1-48f2-96f4-7358aba5f110+11:2354:x1875138574308352:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 61us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271743.428807:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1788271743.428992:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:3.0:1788271743.429092:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271743.430694:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3278:x1875138586922624:12345-0@lo:103:ldlm_bl.0 Request processed in 2794us (5107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271743.430706:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271743.430888:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586922496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271743.431197:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586922624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271743.431343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.431404:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586922368 00000100:00100000:1.0:1788271743.431443:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586922368 00010000:00010000:1.0:1788271743.431487:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 17 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271743.431514:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271743.431522:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3280:x1875138586922368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271743.431534:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271743.431539:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 17 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431550:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 17 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431567:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee7a00/0xbeb05ca97b5f72c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f72bf expref: 17 pid: 5832 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431580:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431588:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431604:0:8506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431612:0:8506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431619:0:8506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431626:0:8506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431642:0:8506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271743.431647:0:8506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431655:0:8506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431676:0:8506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.431686:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271743.431725:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3280:x1875138586922368:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.431732:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271743.431759:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586922368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271743.431882:0:11662:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271743.431891:0:11662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271743.431897:0:11662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f73f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271743.986668:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788271744.030893:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967300 is committed 00000001:00080000:0.0:1788271744.031006:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1788271744.031017:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788271744.031400:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586922752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788271744.031532:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271744.031723:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586922752 00000100:00100000:1.0:1788271744.031734:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586922752 00000100:00100000:1.0:1788271744.031808:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271744.031822:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586922752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788271744.031861:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788271744.031918:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a96dc7a, atime: 0x6a96dc7a, ctime: 0x6a96dc7a, blocks: 0x1 00010000:00010000:1.0:1788271744.031928:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271744.031950:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1788271744.031955:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271744.031981:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271744.032002:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271744.032015:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271744.032024:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271744.032045:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788271744.032783:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586922752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 960us (1248us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788271744.032794:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1788271744.032864:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6ff34ad80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788271744.032872:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586922752:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788271744.033278:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788271744.033503:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:0.0:1788271744.033541:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271744.033552:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271744.033583:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271744.033590:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271744.033602:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271744.033632:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271744.033640:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f73fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271744.033667:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271744.033669:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271744.033671:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788271744.033879:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00010000:00010000:1.0:1788271745.010872:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271745.387269:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271745.387466:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308480 00000100:00100000:1.0:1788271745.387476:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308480 00000100:00100000:1.0:1788271745.387524:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 248 00000100:00100000:1.0:1788271745.387533:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+11:5596:x1875138574308480:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271745.387552:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271745.387570:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6c00/0xbeb05ca97b5f7401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023860 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.387618:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6c00/0xbeb05ca97b5f7401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023860 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.387630:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6c00/0xbeb05ca97b5f7401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023860 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.387639:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6c00, rc 0) 00000100:00100000:1.0:1788271745.387697:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574308480:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 164us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.387704:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 248 10000000:01000000:1.0:1788271745.394558:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271745.394566:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6ee935800 from 7 10000000:01000000:1.0:1788271745.394571:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271745.394615:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.394626:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.394636:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271745.394659:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586922880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.394723:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271745.394823:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271745.395044:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586922880 00000100:00100000:0.0:1788271745.395052:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586922880 00000100:00100000:0.0:1788271745.395295:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788271745.395446:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:5834:x1875138586922880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271745.395461:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271745.395473:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6ff375800/0xbeb05ca97b5f740f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7408 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.395580:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ff375800/0xbeb05ca97b5f740f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7408 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.395589:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6ff375800/0xbeb05ca97b5f740f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7408 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.395598:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375800, rc 0) 00000100:00100000:0.0:1788271745.395651:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586922880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271745.395771:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586922880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271745.395805:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271745.395817:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271745.395923:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271745.395981:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271745.396037:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff3709c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271745.396073:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923008 00000100:00100000:2.0:1788271745.396089:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923008 00000100:00100000:0.0:1788271745.396216:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788271745.396596:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271745.397150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308608 00000100:00100000:2.0:1788271745.397156:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308608 00000100:00100000:2.0:1788271745.397185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788271745.397194:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586923008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.397333:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 251 00000100:00100000:1.0:1788271745.397345:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574308608:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271745.397623:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586923008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 428us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271745.397630:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788271745.397704:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574308608:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 362us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.397711:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 251 00000100:00100000:3.0:1788271745.398195:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271745.398533:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271745.398619:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271745.398667:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923136 00000100:00100000:0.0:1788271745.398677:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923136 00000100:00100000:3.0:1788271745.398679:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff3709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271745.398727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788271745.398735:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586923136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271745.398933:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586923136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271745.398941:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788271745.399185:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271745.401671:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271745.401795:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308736 00000100:00100000:1.0:1788271745.401808:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308736 00000100:00100000:1.0:1788271745.401941:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 253 00000100:00100000:1.0:1788271745.401951:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574308736:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.402181:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574308736:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 230us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.402188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 253 00000100:00100000:3.0:1788271745.407143:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271745.407365:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308864 00000100:00100000:1.0:1788271745.407375:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308864 00000100:00100000:1.0:1788271745.407448:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 254 00000100:00100000:1.0:1788271745.407459:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:9982:x1875138574308864:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271745.407707:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:9982:x1875138574308864:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 249us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.407715:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 254 00000100:00100000:0.0:1788271745.411225:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271745.411360:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574308992 00000100:00100000:1.0:1788271745.411370:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574308992 00000100:00100000:1.0:1788271745.411457:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 255 00000100:00100000:1.0:1788271745.411468:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+12:9982:x1875138574308992:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271745.411818:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11679:1875138586923264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.411959:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+12:9982:x1875138574308992:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 492us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.411968:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 255 00000100:00100000:0.0:1788271745.412173:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271745.412216:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271745.412444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923264 00000100:00100000:1.0:1788271745.412450:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923264 00000100:00100000:1.0:1788271745.412482:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788271745.412490:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:11679:x1875138586923264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.412625:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:11679:x1875138586923264:12345-0@lo:502:llog_process_th.0 Request processed in 135us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.412631:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788271745.413200:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11679:1875138586923264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788271745.413233:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271745.413244:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271745.413496:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271745.413505:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab6ee935800 00000020:00000080:0.0:1788271745.413508:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788271745.413594:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11679:1875138586923392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271745.413642:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271745.413824:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271745.418441:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923392 00000100:00100000:2.0:1788271745.418452:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923392 00000100:00100000:2.0:1788271745.418506:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788271745.418516:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:11679:x1875138586923392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271745.418778:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:11679:x1875138586923392:12345-0@lo:502:llog_process_th.0 Request processed in 262us (5135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271745.418786:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788271745.418850:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11679:1875138586923392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271745.418895:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271745.418904:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271745.418906:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788271745.418912:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788271745.418970:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788271745.418987:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271745.418996:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271745.419007:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271745.419018:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788271745.419020:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c914a800 from 7 10000000:01000000:2.0:1788271745.419023:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271745.419051:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271745.419060:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271745.419069:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271745.419101:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271745.419143:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271745.419173:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788271745.419185:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923520 00000100:00100000:2.0:1788271745.419188:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923520 00000100:00100000:2.0:1788271745.419207:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788271745.419213:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:5834:x1875138586923520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271745.419222:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271745.419233:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f741d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271745.422205:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f741d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7416 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271745.422958:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f741d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f7416 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271745.422971:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b400, rc 0) 00000100:00100000:2.0:1788271745.423188:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586923520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3972us (4041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271745.423197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788271745.424791:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271745.424992:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574309120 00000100:00100000:3.0:1788271745.425001:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574309120 00000100:00100000:3.0:1788271745.425095:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 259 00000100:00100000:3.0:1788271745.425105:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+12:5596:x1875138574309120:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271745.425121:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271745.425135:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19800/0xbeb05ca97b5f7424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023867 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271745.425159:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19800/0xbeb05ca97b5f7424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023867 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271745.425169:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19800/0xbeb05ca97b5f7424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023867 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271745.425177:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19800, rc 0) 00000100:00100000:3.0:1788271745.425235:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574309120:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 132us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271745.425242:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 259 00000100:00100000:3.0:1788271745.430235:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271745.430381:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574309248 00000100:00100000:3.0:1788271745.430390:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574309248 00000100:00100000:3.0:1788271745.430684:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 260 00000100:00100000:3.0:1788271745.430695:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574309248:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271745.432510:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574309248:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 1808us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271745.432537:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 260 00000100:00100000:1.0:1788271745.434407:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc167b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271745.434462:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.434476:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271745.434558:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.434610:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271745.434646:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271745.437846:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923648 00000100:00100000:3.0:1788271745.437863:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923648 00000100:00100000:3.0:1788271745.437944:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788271745.437956:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586923648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271745.438345:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586923648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 391us (3734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271745.438363:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788271745.438623:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.438677:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.438724:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271745.438764:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271745.438778:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923776 00000100:00100000:1.0:1788271745.438782:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923776 00000100:00100000:1.0:1788271745.438804:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788271745.438812:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586923776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.438964:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586923776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.438979:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788271745.439017:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586923776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.439201:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11681:1875138586923904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.439235:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271745.439456:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586923904 00000100:00100000:1.0:1788271745.439460:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586923904 00000100:00100000:1.0:1788271745.439481:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788271745.439488:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:11681:x1875138586923904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.439623:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:11681:x1875138586923904:12345-0@lo:502:llog_process_th.0 Request processed in 134us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.439630:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788271745.439663:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6edd7a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271745.439675:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11681:1875138586923904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271745.439696:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271745.439705:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271745.439708:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788271745.439713:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab6c914a800 00000020:00000080:1.0:1788271745.439715:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788271745.440168:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11681:1875138586924032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.440200:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271745.440218:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924032 00000100:00100000:1.0:1788271745.440221:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924032 00000100:00100000:1.0:1788271745.440235:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788271745.440241:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:11681:x1875138586924032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.443676:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:11681:x1875138586924032:12345-0@lo:502:llog_process_th.0 Request processed in 3424us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.443697:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788271745.443765:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271745.445313:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11681:1875138586924032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271745.445357:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271745.445368:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271745.445370:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788271745.445375:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788271745.446181:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788271745.446206:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271745.446217:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.446229:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271745.446239:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271745.446242:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c9170000 from 7 10000000:01000000:0.0:1788271745.446245:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271745.446289:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.446297:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.446307:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271745.446328:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586924160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271745.446387:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271745.446453:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271745.447350:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924160 00000100:00100000:1.0:1788271745.447360:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924160 00000100:00100000:1.0:1788271745.447435:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788271745.447445:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:5834:x1875138586924160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271745.447459:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271745.447472:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f7432 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f742b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.447495:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f7432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f742b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.447506:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f7432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f742b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271745.447515:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7000, rc 0) 00000100:00100000:1.0:1788271745.447564:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586924160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.447571:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788271745.448528:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586924160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271745.448557:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.448568:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271745.448632:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586924288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271745.448672:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271745.448701:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271745.448975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924288 00000100:00100000:1.0:1788271745.448980:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924288 00000100:00100000:1.0:1788271745.449011:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788271745.449026:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586924288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271745.449190:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271745.449286:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586924288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.449294:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788271745.449325:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574309376 00000100:00100000:0.0:1788271745.449327:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586924288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.449328:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574309376 00000100:00100000:0.0:1788271745.449359:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586924416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271745.449396:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271745.449410:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271745.449623:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 267 00000100:00100000:1.0:1788271745.449630:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574309376:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.449783:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:5596:x1875138574309376:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 151us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.449791:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 267 00000100:00100000:1.0:1788271745.449805:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924416 00000100:00100000:1.0:1788271745.449808:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924416 00000100:00100000:1.0:1788271745.449821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788271745.449826:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586924416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.449930:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:5834:x1875138586924416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.449937:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788271745.449976:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e92ad5e1-0f38-442e-8a6a-19627f637d27:5834:1875138586924416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271745.450278:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11683:1875138586924544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.450793:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271745.450827:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271745.450904:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924544 00000100:00100000:0.0:1788271745.450909:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924544 00000100:00100000:0.0:1788271745.450945:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788271745.450953:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:11683:x1875138586924544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271745.451112:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:11683:x1875138586924544:12345-0@lo:502:llog_process_th.0 Request processed in 159us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271745.451120:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788271745.451356:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11683:1875138586924544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271745.451382:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271745.451395:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271745.451398:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788271745.451405:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab6c9170000 00000020:00000080:1.0:1788271745.451408:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788271745.451512:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11683:1875138586924672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271745.451546:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271745.451567:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271745.451982:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924672 00000100:00100000:0.0:1788271745.451987:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924672 00000100:00100000:0.0:1788271745.452020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788271745.452028:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:11683:x1875138586924672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271745.453630:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:11683:x1875138586924672:12345-0@lo:502:llog_process_th.0 Request processed in 1596us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271745.453650:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788271745.453803:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e92ad5e1-0f38-442e-8a6a-19627f637d27:11683:1875138586924672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271745.453834:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271745.453840:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271745.453842:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788271745.453846:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788271745.454047:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788271745.454068:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271745.454077:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271745.454151:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271745.458725:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788271745.459482:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271745.460168:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574309504 00000100:00100000:0.0:1788271745.460179:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574309504 00000100:00100000:0.0:1788271745.460358:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 271 00000100:00100000:0.0:1788271745.460370:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:9985:x1875138574309504:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271745.460629:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:9985:x1875138574309504:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 261us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271745.460637:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 271 00000100:00100000:0.0:1788271745.463240:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271745.463375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574309632 00000100:00100000:1.0:1788271745.463384:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574309632 00000100:00100000:1.0:1788271745.463630:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 272 00000100:00100000:1.0:1788271745.463642:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:9985:x1875138574309632:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271745.465036:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:9985:x1875138574309632:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 1389us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.465047:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 272 00000100:00100000:0.0:1788271745.646180:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271745.646233:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271745.646264:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271745.646536:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574309760 00000100:00100000:2.0:1788271745.646547:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574309760 00000100:00100000:2.0:1788271745.646609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310016 00000100:00100000:2.0:1788271745.646612:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310016 00000100:00100000:2.0:1788271745.646637:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:2.0:1788271745.646647:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2352:x1875138574309760:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271745.646746:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2352:x1875138574309760:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 89us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271745.646754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:2.0:1788271745.646775:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:2.0:1788271745.646781:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574310016:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271745.646806:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574310016:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271745.646813:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:1.0:1788271745.646937:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574309888 00000100:00100000:1.0:1788271745.646941:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574309888 00000100:00100000:1.0:1788271745.646981:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:1.0:1788271745.646989:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574309888:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271745.647017:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574309888:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 29us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.647023:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00080000:0.0:1788271745.647834:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271745.647840:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271746.037947:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271746.484778:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271747.058600:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271748.082686:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271748.083115:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586925184:0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.083191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.083495:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788271748.083503:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586925056:0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.083528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.083543:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586925568:0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.083565:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.083598:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925568 00000100:00100000:1.0:1788271748.083604:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925568 00000100:00100000:1.0:1788271748.083652:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788271748.083660:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586925568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.083706:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586925568:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.083712:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788271748.083746:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6edf28700 x1875138586925568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271748.083758:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586925568:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.083997:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925184 00000100:00100000:2.0:1788271748.084002:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925184 00000100:00100000:2.0:1788271748.084036:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925056 00000100:00100000:2.0:1788271748.084038:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925056 00000100:00100000:2.0:1788271748.084066:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788271748.084073:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586925184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.084124:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586925184:12345-0@lo:400:kworker.0 Request processed in 52us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271748.084130:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788271748.084145:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788271748.084150:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586925056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.084179:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586925056:12345-0@lo:400:kworker.0 Request processed in 21us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271748.084184:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788271748.084209:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586925056:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.084218:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586925184:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.084655:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586924800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271748.084693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271748.084727:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586925312:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.084759:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271748.084782:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788271748.084788:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586924928:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.084815:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271748.084858:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586925440:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.084883:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271748.084914:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925312 00000100:00100000:0.0:1788271748.084918:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925312 00000100:00100000:0.0:1788271748.084952:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271748.084960:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586925312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.084999:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586925312:12345-0@lo:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271748.085005:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788271748.085026:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271748.085031:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271748.085033:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271748.085044:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925440 00000100:00100000:0.0:1788271748.085048:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925440 00000100:00100000:0.0:1788271748.085075:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788271748.085081:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586925440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.085112:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586925440:12345-0@lo:400:kworker.0 Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271748.085119:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788271748.085132:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271748.085150:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586925440:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.085159:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586925312:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.085196:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924928 00000100:00100000:0.0:1788271748.085199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924928 00000100:00100000:0.0:1788271748.085222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788271748.085228:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586924928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.085261:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586924928:12345-0@lo:400:kworker.0 Request processed in 33us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271748.085267:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788271748.085310:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586924928:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.086543:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586924800 00000100:00100000:2.0:1788271748.086551:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586924800 00000100:00100000:2.0:1788271748.086603:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788271748.086612:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586924800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271748.086647:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271748.086706:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586924800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271748.086713:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788271748.086949:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586924800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271748.088805:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271748.088823:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586925696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271748.088890:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271748.089235:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925696 00000100:00100000:3.0:1788271748.089243:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925696 00000100:00100000:3.0:1788271748.089870:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271748.089882:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586925696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271748.089916:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271748.090078:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586925696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271748.090083:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788271748.090633:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cab9a680 x1875138586925696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271748.090655:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586925696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788271749.106692:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788271749.155960:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788271750.132717:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271750.771015:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271750.771069:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271750.771100:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271750.771149:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271750.771193:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310400 00000100:00100000:2.0:1788271750.771205:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310400 00000100:00100000:2.0:1788271750.771294:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:2.0:1788271750.771306:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574310400:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271750.771404:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574310400:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 100us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271750.771448:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00080000:2.0:1788271750.771476:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271750.771670:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310272 00000100:00100000:0.0:1788271750.771675:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310272 00000100:00100000:0.0:1788271750.771717:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310528 00000100:00100000:0.0:1788271750.771720:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310528 00000100:00100000:0.0:1788271750.771740:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:0.0:1788271750.771747:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2352:x1875138574310272:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271750.771797:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2352:x1875138574310272:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 49us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271750.771803:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:0.0:1788271750.771835:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:0.0:1788271750.771841:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574310528:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271750.771865:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574310528:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271750.771872:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:1.0:1788271750.772129:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310144 00000100:00100000:1.0:1788271750.772136:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310144 00000100:00100000:1.0:1788271750.772180:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 274 00000100:00100000:1.0:1788271750.772189:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574310144:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271750.772236:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574310144:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 48us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271750.772244:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 274 00000100:00080000:2.0:1788271750.775288:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788271751.155487:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271752.179394:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271753.206259:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271753.206364:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586925952:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.206507:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.206582:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586926464:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.206615:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.206654:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788271753.206680:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586925824:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.206716:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.206752:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586926336:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.206777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.206811:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586926208:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.206837:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.206859:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271753.206865:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586926080:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.206888:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.206923:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926464 00000100:00100000:2.0:1788271753.206933:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926464 00000100:00100000:2.0:1788271753.206997:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926208 00000100:00100000:2.0:1788271753.207001:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926208 00000100:00100000:2.0:1788271753.207029:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788271753.207040:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586926464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207105:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586926464:12345-0@lo:400:kworker.0 Request processed in 66us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.207113:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788271753.207137:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271753.207144:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586926208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207176:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586926208:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.207182:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271753.207202:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925824 00000100:00100000:2.0:1788271753.207205:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925824 00000100:00100000:2.0:1788271753.207226:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788271753.207232:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586925824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207270:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586925824:12345-0@lo:400:kworker.0 Request processed in 37us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.207276:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788271753.207309:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586925952 00000100:00100000:2.0:1788271753.207312:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586925952 00000100:00100000:2.0:1788271753.207338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926336 00000100:00100000:2.0:1788271753.207341:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926336 00000100:00100000:2.0:1788271753.207354:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926080 00000100:00100000:2.0:1788271753.207356:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926080 00000100:00100000:2.0:1788271753.207369:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788271753.207375:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586925952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207404:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586925952:12345-0@lo:400:kworker.0 Request processed in 29us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.207410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788271753.207445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788271753.207451:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586926336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207474:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586926336:12345-0@lo:400:kworker.0 Request processed in 24us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.207480:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788271753.207489:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788271753.207494:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586926080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207519:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586926080:12345-0@lo:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.207524:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788271753.207547:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271753.207553:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271753.207555:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271753.207603:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586926080:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207614:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788271753.207619:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6ff34ad80, transno 4294967300 00000100:00100000:2.0:1788271753.207630:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586926208:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207659:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586925824:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207670:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586926336:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.207679:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586925952:0@lo:400:kworker.0 00010000:00080000:2.0:1788271753.207692:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34ea00 x1875138586926464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271753.207703:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586926464:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.208794:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271753.208812:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586926592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271753.208871:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271753.208919:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926592 00000100:00100000:0.0:1788271753.208924:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926592 00000100:00100000:0.0:1788271753.208967:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271753.208977:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586926592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271753.209013:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271753.209059:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586926592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.209066:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271753.209111:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586926592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271753.209505:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586926720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271753.209536:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.209603:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926720 00000100:00100000:2.0:1788271753.209608:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926720 00000100:00100000:2.0:1788271753.209645:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788271753.209653:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586926720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271753.209678:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271753.209990:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586926720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 336us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.209998:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788271753.210327:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34c380 x1875138586926720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271753.210346:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586926720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788271754.226691:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271755.251032:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271755.886185:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271755.886258:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271755.886296:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271755.886343:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271755.886395:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310912 00000100:00100000:2.0:1788271755.886410:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310912 00000100:00100000:2.0:1788271755.886559:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:2.0:1788271755.886571:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574310912:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271755.886670:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574310912:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 100us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271755.886674:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310784 00000100:00100000:2.0:1788271755.886678:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:1.0:1788271755.886679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310784 00000100:00100000:1.0:1788271755.886726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311040 00000100:00080000:2.0:1788271755.886728:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271755.886729:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311040 00000100:00080000:2.0:1788271755.886734:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271755.886736:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271755.886754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 111 00000100:00100000:1.0:1788271755.886762:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574310784:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271755.886779:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:2.0:1788271755.886786:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574311040:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271755.886794:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574310784:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 35us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271755.886801:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 111 00000100:00100000:2.0:1788271755.886808:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574311040:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 24us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271755.886814:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:3.0:1788271755.886975:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574310656 00000100:00100000:3.0:1788271755.886981:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574310656 00000100:00100000:3.0:1788271755.887020:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 276 00000100:00100000:3.0:1788271755.887028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574310656:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271755.887068:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574310656:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 41us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271755.887075:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 276 00010000:00010000:1.0:1788271756.277009:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271756.723065:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271757.298704:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271758.322813:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271758.322814:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586927104:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.322950:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586926848:0@lo:400:kworker.0 00000100:00100000:3.0:1788271758.322960:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.323052:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.323092:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586927232:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.323123:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271758.323299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586927104 00000100:00100000:1.0:1788271758.323312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586927104 00000100:00100000:3.0:1788271758.323313:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926848 00000100:00100000:3.0:1788271758.323323:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926848 00000100:00100000:1.0:1788271758.323390:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788271758.323403:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586927104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271758.323486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586927104:12345-0@lo:400:kworker.0 Request processed in 86us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271758.323493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788271758.323555:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586927360:0@lo:400:kworker.0 00000100:00100000:1.0:1788271758.323586:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271758.323596:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788271758.323608:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586926848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271758.323623:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788271758.323635:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586926976:0@lo:400:kworker.0 00000100:00100000:2.0:1788271758.323749:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586927232 00000100:00100000:2.0:1788271758.323756:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586927232 00000100:00100000:2.0:1788271758.323797:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788271758.323806:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586927232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.324834:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586927744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271758.324951:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271758.324989:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586927488:0@lo:400:kworker.0 00000100:00100000:1.0:1788271758.325035:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271758.325080:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586926848:0@lo:400:kworker.0 00000100:00100000:1.0:1788271758.325137:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586927360 00000100:00100000:1.0:1788271758.325143:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586927360 00000100:00100000:1.0:1788271758.325189:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586926976 00000100:00100000:1.0:1788271758.325193:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586926976 00000100:00100000:3.0:1788271758.325227:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586926848:12345-0@lo:400:kworker.0 Request processed in 1614us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271758.325239:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788271758.325757:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788271758.325771:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586927360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271758.325836:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586927360:12345-0@lo:400:kworker.0 Request processed in 69us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271758.325844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788271758.326602:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586927232:12345-0@lo:400:kworker.0 Request processed in 2793us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271758.326614:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788271758.326644:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586927488 00000100:00100000:2.0:1788271758.326659:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586927488 00000100:00100000:2.0:1788271758.326703:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788271758.326712:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586927488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271758.326755:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586927488:12345-0@lo:400:kworker.0 Request processed in 45us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271758.326782:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788271758.326809:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271758.326814:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271758.326817:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271758.326831:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788271758.326839:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586926976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271758.326877:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586926976:12345-0@lo:400:kworker.0 Request processed in 39us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271758.326883:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788271758.326948:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586927616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271758.326990:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271758.327043:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586927104:0@lo:400:kworker.0 00000100:00100000:3.0:1788271758.330547:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586927616 00000100:00100000:3.0:1788271758.330562:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586927616 00000100:00100000:3.0:1788271758.330624:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788271758.330635:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586927616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271758.330688:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271758.330784:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586927616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271758.330792:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788271758.330850:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6c57c0a80 x1875138586927616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271758.330872:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586927616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271758.331474:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.331552:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586927232:0@lo:400:kworker.0 00000100:00100000:2.0:1788271758.331731:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586926976:0@lo:400:kworker.0 00010000:00080000:2.0:1788271758.331749:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ff34d180 x1875138586927488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271758.331761:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586927488:0@lo:400:kworker.0 00000100:00100000:2.0:1788271758.331776:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586927360:0@lo:400:kworker.0 00000100:00100000:3.0:1788271758.333201:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586927744 00000100:00100000:3.0:1788271758.333215:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586927744 00000100:00100000:3.0:1788271758.333289:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788271758.333301:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586927744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271758.333394:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271758.333526:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586927744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271758.333533:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788271758.333660:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586927744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788271759.346688:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271760.370732:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271761.005399:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271761.005535:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271761.005593:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311296 00000100:00100000:3.0:1788271761.005629:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311296 00000100:00100000:3.0:1788271761.005887:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:3.0:1788271761.005898:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574311296:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271761.005968:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574311296:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 72us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271761.005975:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00080000:2.0:1788271761.008383:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271761.011444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311168 00000100:00100000:0.0:1788271761.011459:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311168 00000100:00100000:0.0:1788271761.011535:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 278 00000100:00100000:0.0:1788271761.011546:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574311168:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271761.011669:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574311168:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 123us (6280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271761.011678:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 278 00000100:00100000:2.0:1788271761.026134:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271761.026176:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271761.026303:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311424 00000100:00100000:3.0:1788271761.026308:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311552 00000100:00100000:0.0:1788271761.026314:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311424 00000100:00100000:3.0:1788271761.026315:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311552 00000100:00100000:0.0:1788271761.026398:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1788271761.026540:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2350:x1875138574311424:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:1.0:1788271761.026573:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f736e 00000100:00080000:1.0:1788271761.026582:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8ab6fee10800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271761.026640:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788271761.026905:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+2:2350:x1875138574311424:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 495us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271761.026913:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00010000:00010000:1.0:1788271761.026934:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271761.034893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:1.0:1788271761.034910:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574311552:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271761.035029:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574311552:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 123us (8849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271761.035039:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00080000:2.0:1788271761.041213:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271761.041224:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788271761.395211:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271762.420319:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271763.442680:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586928000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271763.442751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271763.442809:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586927872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271763.442830:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271763.442851:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271763.442856:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586928512:0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.442878:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271763.442893:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586928128:0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.442917:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271763.442935:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271763.442940:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586928640:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.442947:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586928384:0@lo:400:kworker.0 00000100:00100000:3.0:1788271763.443006:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928000 00000100:00100000:3.0:1788271763.443013:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928000 00000100:00100000:3.0:1788271763.443062:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586927872 00000100:00100000:3.0:1788271763.443066:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586927872 00000100:00100000:3.0:1788271763.443083:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00010000:00010000:1.0:1788271763.443089:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271763.443091:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586928000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271763.443132:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00002000:00000024:3.0:1788271763.443134:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271763.443140:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586927872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271763.443157:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271763.445677:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271763.445767:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928512 00000100:00100000:2.0:1788271763.445776:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928512 00000100:00100000:2.0:1788271763.445826:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788271763.445837:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586928512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.445911:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586928512:12345-0@lo:400:kworker.0 Request processed in 76us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271763.445919:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788271763.445946:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271763.445950:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271763.447263:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586928512:0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.447325:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ca62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586928256:0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.447372:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271763.447446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928128 00000100:00100000:2.0:1788271763.447452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928128 00000100:00100000:2.0:1788271763.447501:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788271763.447508:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586928128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.447549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586928128:12345-0@lo:400:kworker.0 Request processed in 41us (4630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271763.447567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788271763.447603:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586928128:0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.447629:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928640 00000100:00100000:2.0:1788271763.447632:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928640 00000100:00100000:2.0:1788271763.447663:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928256 00000100:00100000:2.0:1788271763.447666:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928256 00000100:00100000:2.0:1788271763.447680:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788271763.447686:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586928640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.447720:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586928640:12345-0@lo:400:kworker.0 Request processed in 34us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271763.447727:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788271763.447739:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788271763.447744:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586928256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.447773:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586928256:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271763.447779:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788271763.447801:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586928256:0@lo:400:kworker.0 00000100:00080000:2.0:1788271763.447815:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271763.447830:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586928640:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.450058:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271763.450366:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928384 00000100:00100000:2.0:1788271763.450374:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928384 00000100:00100000:2.0:1788271763.450458:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788271763.450480:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586928384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.450544:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586928384:12345-0@lo:400:kworker.0 Request processed in 66us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271763.450552:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788271763.450682:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586928000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7590us (7930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271763.450691:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788271763.450776:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6c57c3480 x1875138586928000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271763.450797:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586928000:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788271763.450861:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271763.450882:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ca62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586928384:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.451814:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586927872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8671us (8978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271763.451824:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788271763.452079:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586927872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788271764.470066:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788271764.543670:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:0.0:1788271764.543679:0:6722:0:(genops.c:885:class_export_put()) final put ffff8ab6fee16800/896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:1.0:1788271764.545740:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6fee16800/896349b1-dd1e-47e2-bcd1-0ecd5d75458e for lustre-OST0000 00000020:00000080:1.0:1788271764.545807:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6fee10800 for lustre-OST0000 00010000:00010000:1.0:1788271765.498599:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271766.127901:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271766.127952:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271766.127986:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271766.128093:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311680 00000100:00100000:3.0:1788271766.128104:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311680 00000100:00100000:3.0:1788271766.128169:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 280 00000100:00100000:3.0:1788271766.128178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2352:x1875138574311680:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271766.128248:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2352:x1875138574311680:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271766.128270:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 280 00000100:00100000:1.0:1788271766.128675:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311936 00000100:00100000:1.0:1788271766.128680:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311936 00000100:00100000:1.0:1788271766.128729:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574311808 00000100:00100000:1.0:1788271766.128732:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574311808 00000100:00100000:1.0:1788271766.128754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1788271766.128761:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574311936:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271766.128801:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574311936:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 41us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271766.128807:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1788271766.128820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:1.0:1788271766.128827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2352:x1875138574311808:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271766.128850:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2352:x1875138574311808:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 23us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271766.128857:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00080000:3.0:1788271766.129477:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271766.519249:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788271766.964236:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788271767.182873:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:09:25 (1788271765) 00010000:00010000:1.0:1788271767.539480:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271768.547251:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271768.547389:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574312064 00000100:00100000:1.0:1788271768.547401:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574312064 00000100:00100000:1.0:1788271768.547577:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:1.0:1788271768.547601:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:10254:x1875138574312064:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271768.547631:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271768.547664:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102386e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.547760:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7440 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.547777:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.547794:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271768.548068:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788271768.548073:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271768.548193:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.548979:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102386e expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.549016:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102386e expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.549027:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:1.0:1788271768.549042:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271768.549047:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7800, rc 0) 00000100:00100000:1.0:1788271768.549155:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:10254:x1875138574312064:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1557us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.549174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00080000:3.0:1788271768.549997:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271768.554828:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271768.559578:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574312192 00000100:00100000:2.0:1788271768.559612:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574312192 00000100:00100000:2.0:1788271768.559715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1788271768.559728:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:10255:x1875138574312192:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271768.559756:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271768.559785:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023875 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.559896:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.559915:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.559948:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.559968:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.559976:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.559984:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560538:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f745c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560549:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f745c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560557:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f745c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271768.560655:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788271768.560660:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271768.560746:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f745c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560760:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560768:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560787:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560794:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271768.560799:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560808:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560824:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:2.0:1788271768.560828:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271768.560834:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560841:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f744e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560858:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560865:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560871:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560876:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271768.560879:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560895:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560904:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ab6c4f64600) 00010000:00010000:2.0:1788271768.560907:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271768.560910:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560917:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7455 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560955:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023875 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560972:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f745c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023875 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.560980:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab6c4f64400) 00010000:00010000:2.0:1788271768.560982:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271768.560985:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024bc00, rc 0) 00000100:00100000:2.0:1788271768.561092:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:10255:x1875138574312192:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1366us (6279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.561102:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:0.0:1788271768.562931:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586928896:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563019:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.563095:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586929408:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563125:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.563161:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788271768.563168:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586928768:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563200:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.563221:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586929280:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563243:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.563270:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586929152:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563309:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.563327:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271768.563332:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586929024:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563354:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.563383:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586929408 00000100:00100000:0.0:1788271768.563391:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586929408 00000100:00100000:0.0:1788271768.563489:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586929152 00000100:00100000:0.0:1788271768.563493:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586929152 00000100:00100000:0.0:1788271768.563517:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788271768.563527:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586929408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563599:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586929408:12345-0@lo:400:kworker.0 Request processed in 73us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271768.563606:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788271768.563626:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271768.563632:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586929152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.563663:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586929152:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271768.563687:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271768.563727:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586929152:0@lo:400:kworker.0 00010000:00080000:0.0:1788271768.563761:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6cab9ed80 x1875138586929408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271768.563772:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586929408:0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.564128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928896 00000100:00100000:1.0:1788271768.564134:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928896 00000100:00100000:1.0:1788271768.564171:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586929280 00000100:00100000:1.0:1788271768.564174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586929280 00000100:00100000:1.0:1788271768.564189:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586929024 00000100:00100000:1.0:1788271768.564192:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586929024 00000100:00100000:1.0:1788271768.564207:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271768.564214:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586928896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.564262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586928896:12345-0@lo:400:kworker.0 Request processed in 49us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.564269:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271768.564298:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271768.564305:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586929280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.564332:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586929280:12345-0@lo:400:kworker.0 Request processed in 28us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.564338:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271768.564349:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788271768.564355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586929024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.564383:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586929024:12345-0@lo:400:kworker.0 Request processed in 28us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.564390:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:2.0:1788271768.565052:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788271768.565065:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271768.565071:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271768.565075:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271768.565079:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586928768 00000100:00100000:2.0:1788271768.565084:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586928768 00000100:00100000:2.0:1788271768.565125:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788271768.565134:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586928768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.565197:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586928768:12345-0@lo:400:kworker.0 Request processed in 65us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.565204:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788271768.565455:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586929664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271768.565508:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.565563:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586929024:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.565599:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271768.565606:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586929536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271768.565632:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.565673:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586928768:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.565686:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586929280:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.565698:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586928896:0@lo:400:kworker.0 00000100:00100000:3.0:1788271768.570484:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586929664 00000100:00100000:3.0:1788271768.570508:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586929664 00000100:00100000:3.0:1788271768.570587:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586929536 00000100:00100000:3.0:1788271768.570591:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586929536 00000100:00100000:3.0:1788271768.570616:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788271768.570628:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586929664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271768.570688:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271768.570751:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271768.570764:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586929536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271768.570789:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271768.570836:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586929536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271768.570843:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271768.570934:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586929536:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788271768.570977:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6ee0c3100 x1875138586929664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271768.570994:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586929664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271768.573205:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586929664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (5306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271768.573223:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271768.574646:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271768.574728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574312448 00000100:00100000:0.0:1788271768.574740:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574312448 00000100:00100000:0.0:1788271768.574803:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:0.0:1788271768.574826:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:10255:x1875138574312448:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271768.574855:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271768.574883:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7463 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102387c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.574978:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.574996:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.575011:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.575043:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.575051:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.575231:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.575934:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375200/0xbeb05ca97b5f7478 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.575948:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375200/0xbeb05ca97b5f7478 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.575957:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375200/0xbeb05ca97b5f7478 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271768.575968:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788271768.576879:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576894:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576903:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576909:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271768.576914:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576922:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576941:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab6c4f64400) 00010000:00010000:0.0:1788271768.576945:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271768.576952:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576974:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f746a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576991:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.576998:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.577004:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.577009:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271768.577013:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.577148:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.577157:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab6c2fd1800) 00010000:00010000:0.0:1788271768.577160:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271768.577163:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.577170:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7471 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.578501:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7463 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102387c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.578531:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375200/0xbeb05ca97b5f7478 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102387c expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.578550:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:0.0:1788271768.578553:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271768.578557:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375200, rc 0) 00000100:00100000:0.0:1788271768.578662:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:10255:x1875138574312448:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 3847us (4025us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788271768.578671:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:3.0:1788271768.584528:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271768.584633:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574312576 00000100:00100000:2.0:1788271768.584647:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574312576 00000100:00100000:2.0:1788271768.584739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:2.0:1788271768.584752:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:10255:x1875138574312576:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788271768.584919:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:10255:x1875138574312576:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 Request processed in 168us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.584928:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000040:00080000:2.0:1788271769.016206:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271769.587180:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788271769.624833:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1788271770.594790:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271770.595131:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574312704 00000100:00100000:0.0:1788271770.595145:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574312704 00000100:00100000:0.0:1788271770.595271:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:0.0:1788271770.595287:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:10297:x1875138574312704:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271770.595315:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271770.595342:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023883 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.595648:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.595665:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.595683:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.595701:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.595709:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.595731:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596101:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596109:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596117:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596124:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271770.596130:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596139:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596155:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:0.0:1788271770.596158:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271770.596163:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596169:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f748d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596181:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596186:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596198:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596203:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271770.596207:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596214:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596222:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab6c2fd1100) 00010000:00010000:0.0:1788271770.596224:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271770.596226:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596232:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7494 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596277:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7486 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023883 expref: 9 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596289:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:0.0:1788271770.596291:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271770.596295:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023883 expref: 9 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.596306:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375000, rc 0) 00000100:00100000:0.0:1788271770.596393:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:10297:x1875138574312704:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1111us (1618us total) trans 0 rc 301/301 00000100:00100000:0.0:1788271770.597958:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00080000:2.0:1788271770.598153:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271770.609955:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271770.610048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574312960 00000100:00100000:1.0:1788271770.610065:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574312960 00000100:00100000:1.0:1788271770.610146:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1788271770.610160:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:10297:x1875138574312960:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:1.0:1788271770.610234:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271770.610269:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7440 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102386e expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.610289:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:1.0:1788271770.610301:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271770.610671:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.610688:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.610698:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.610726:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.610732:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.610739:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271770.611864:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788271770.611880:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.611896:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.611904:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.611911:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271770.611917:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.611926:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.611940:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419700) 00010000:00010000:1.0:1788271770.611943:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271770.611948:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.611954:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f749b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271770.611972:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004e9cece reply state 0000000047512fdf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271770.611983:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271770.612126:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:10297:x1875138574312960:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 1966us (2177us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788271770.612137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00010000:00010000:3.0:1788271770.617339:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.617357:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.617364:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.617370:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271770.617375:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.617399:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.617446:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab6cb419900) 00010000:00010000:3.0:1788271770.617450:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271770.617454:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.617460:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f74a2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.619570:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271770.685266:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271770.685396:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574313088 00000100:00100000:1.0:1788271770.685514:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574313088 00000100:00100000:0.0:1788271770.685649:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:0.0:1788271770.685674:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:10305:x1875138574313088:12345-192.168.201.1@tcp:101:lctl.0 00010000:00010000:0.0:1788271770.685698:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271770.685720:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f74a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102388a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.685790:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f74b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.685803:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f74b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.685815:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f74b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271770.686157:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788271770.686162:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788271770.686207:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f74b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.686296:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f74a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102388a expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.686314:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f74b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102388a expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.686322:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:0.0:1788271770.686335:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271770.686339:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374a00, rc 0) 00000100:00100000:0.0:1788271770.686404:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:10305:x1875138574313088:12345-192.168.201.1@tcp:101:lctl.0 Request processed in 735us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271770.686461:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:1.0:1788271770.732553:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271770.733092:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574313216 00000100:00100000:3.0:1788271770.733106:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574313216 00000100:00100000:3.0:1788271770.733185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:3.0:1788271770.733198:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:10311:x1875138574313216:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271770.733225:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271770.733250:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f74b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023891 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733332:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733348:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733362:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733380:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733405:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733455:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733590:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f74cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733599:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f74cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733606:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f74cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271770.733642:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788271770.733647:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271770.733698:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f74cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733767:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733774:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733914:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733921:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271770.733926:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733942:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733956:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:3.0:1788271770.733959:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271770.733965:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733971:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f74be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733987:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733992:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.733998:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.734003:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271770.734006:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.734011:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.734018:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab6c3e3c000) 00010000:00010000:3.0:1788271770.734021:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271770.734023:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.734040:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f74c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.734092:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f74b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023891 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.734107:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f74cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023891 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.734116:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271770.734118:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788271770.734120:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18600, rc 0) 00000100:00100000:3.0:1788271770.734370:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:10311:x1875138574313216:12345-192.168.201.1@tcp:101:bash.0 Request processed in 1173us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271770.734379:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:3.0:1788271770.744563:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271770.751584:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574313472 00000100:00100000:1.0:1788271770.751605:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574313472 00000100:00100000:1.0:1788271770.751694:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:1.0:1788271770.751709:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:10311:x1875138574313472:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271770.751738:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271770.751769:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f74d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023898 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.751971:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.752502:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.752517:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.752664:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.752689:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.752703:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271770.755042:0:8302:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788271770.755237:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755253:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755271:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755311:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755319:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755326:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755332:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271770.755336:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755344:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755356:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:1.0:1788271770.755359:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271770.755363:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755370:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f74da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271770.755386:0:8302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002824da98 reply state 000000003ffa91be transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271770.755396:0:8302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788271770.755512:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f74d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 13 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755536:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 12 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.755545:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:1.0:1788271770.755547:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271770.755551:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7600, rc 0) 00000100:00100000:1.0:1788271770.755626:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10311:x1875138574313472:12345-192.168.201.1@tcp:101:bash.0 Request processed in 3920us (11079us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788271770.755634:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00010000:00010000:2.0:1788271770.760129:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.760150:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.760156:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.760161:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271770.760165:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.760170:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.760206:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6cb419700) 00010000:00010000:2.0:1788271770.760208:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271770.760212:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.760217:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f74e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271770.763041:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271770.763173:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574313600 00000100:00100000:0.0:1788271770.763188:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574313600 00000100:00100000:0.0:1788271770.763244:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:0.0:1788271770.763255:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875138574313600:12345-192.168.201.1@tcp:8:bash.0 00010000:00080000:0.0:1788271770.763296:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1788271770.763337:0:6697:0:(genops.c:1385:class_connect()) connect: client 896349b1-dd1e-47e2-bcd1-0ecd5d75458e, cookie 0xbeb05ca97b5f74f6 00002000:00100000:0.0:1788271770.763352:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 896349b1-dd1e-47e2-bcd1-0ecd5d75458e/ffff8ab6f7359800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271770.763384:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788271770.763743:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788271770.763851:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ab6f735e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271770.764100:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2350:x1875138574313600:12345-192.168.201.1@tcp:8:bash.0 Request processed in 844us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271770.764108:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1788271770.767735:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271770.767911:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574313728 00000100:00100000:2.0:1788271770.767923:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574313728 00000100:00100000:2.0:1788271770.768093:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:2.0:1788271770.768105:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:0:x1875138574313728:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271770.768128:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271770.768157:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102389f expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271770.768190:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788271770.768212:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1788271770.768217:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271770.768229:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.768251:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.768268:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a400, rc 0) 00000100:00100000:2.0:1788271770.768339:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:0:x1875138574313728:12345-192.168.201.1@tcp:101:bash.0 Request processed in 236us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271770.768360:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00080000:3.0:1788271770.768535:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271770.771178:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271770.771300:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574313856 00000100:00100000:1.0:1788271770.771313:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574313856 00000100:00100000:1.0:1788271770.771485:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:1.0:1788271770.771498:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:10311:x1875138574313856:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271770.771520:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271770.771558:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238a6 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.771599:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 8 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.771609:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271770.771615:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271770.771621:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.771690:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 8 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.771706:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 8 pid: 8463 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271770.771722:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875138586929792:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271770.771830:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271770.775900:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875138586929792:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271770.775949:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.775975:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7800, rc 0) 00000100:00100000:2.0:1788271770.776052:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:10311:x1875138574313856:12345-192.168.201.1@tcp:101:bash.0 Request processed in 4556us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271770.776061:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:3.0:1788271770.777593:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271770.777814:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574313984 00000100:00100000:1.0:1788271770.777825:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574313984 00010000:00010000:1.0:1788271770.777875:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 8 pid: 8463 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271770.777922:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:1.0:1788271770.777932:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574313984:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271770.777952:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271770.777981:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 8 pid: 8463 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.778007:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 8 pid: 8463 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.778037:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8098070/0xbeb05ca97b5f74fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x76932646102389f expref: 8 pid: 8463 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.778079:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271770.778084:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271770.778093:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.778104:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271770.778148:0:8506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271770.778164:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1875138586929920:192.168.201.1@tcp:105: 00000100:00100000:1.0:1788271770.778264:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea449c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271770.781307:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1875138586929920:192.168.201.1@tcp:105: 00010000:00010000:1.0:1788271770.781338:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271770.781944:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574313984:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 4009us (4356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271770.781958:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:1.0:1788271770.783621:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271770.783988:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574314240 00000100:00100000:2.0:1788271770.784000:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574314240 00000100:00100000:2.0:1788271770.784065:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1788271770.784077:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:10311:x1875138574314240:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1788271770.784738:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10311:x1875138574314240:12345-192.168.201.1@tcp:35:bash.0 Request processed in 659us (1123us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788271770.784749:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:1.0:1788271770.862778:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271770.862902:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574314496 00000100:00100000:2.0:1788271770.862916:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574314496 00000100:00100000:2.0:1788271770.862992:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:2.0:1788271770.863005:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10321:x1875138574314496:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271770.863039:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271770.863066:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f750b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238ad expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271770.863218:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788271770.863376:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f750b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238ad expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.863394:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:2.0:1788271770.863397:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271770.863404:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f750b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238ad expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.863818:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b000, rc 0) 00000100:00100000:2.0:1788271770.863954:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:10321:x1875138574314496:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 949us (1187us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788271770.863963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:0.0:1788271770.867199:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271770.867329:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574314752 00000100:00100000:1.0:1788271770.867342:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574314752 00000100:00100000:1.0:1788271770.867739:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1788271770.867754:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:10321:x1875138574314752:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1788271770.868152:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:10321:x1875138574314752:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 401us (967us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788271770.868161:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1788271770.924289:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271770.924456:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574314880 00000100:00100000:0.0:1788271770.924468:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574314880 00000100:00100000:0.0:1788271770.924546:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:0.0:1788271770.924559:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:10327:x1875138574314880:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271770.924593:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271770.924621:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238b4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.924734:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.924752:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.924769:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271770.924846:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1788271770.924850:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788271770.924884:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.924919:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238b4 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.924943:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238b4 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.924952:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271770.924956:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271770.924961:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375a00, rc 0) 00000100:00100000:0.0:1788271770.925042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:10327:x1875138574314880:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 485us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271770.925050:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:3.0:1788271770.932756:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271770.932932:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574315136 00000100:00100000:0.0:1788271770.932945:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574315136 00000100:00100000:0.0:1788271770.933053:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:0.0:1788271770.933066:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:10327:x1875138574315136:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271770.933094:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271770.933122:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7527 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.933259:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f752e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.933276:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f752e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.933289:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f752e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271770.933304:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788271770.933549:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7527 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238bb expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.933575:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f752e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238bb expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.933585:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:0.0:1788271770.933589:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271770.933593:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374c00, rc 0) 00000100:00100000:0.0:1788271770.933661:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:10327:x1875138574315136:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 598us (919us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788271770.933670:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:3.0:1788271770.937203:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271770.937305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574315392 00000100:00100000:0.0:1788271770.937336:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574315392 00000100:00100000:0.0:1788271770.937465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1788271770.937479:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:10327:x1875138574315392:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271770.937510:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271770.937539:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f753c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238c2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.937665:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7543 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.937684:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.937698:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271770.937712:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788271770.937889:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f753c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238c2 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.937911:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238c2 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271770.937919:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:0.0:1788271770.937922:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788271770.937926:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375400, rc 0) 00000100:00100000:0.0:1788271770.938001:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:10327:x1875138574315392:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 525us (814us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788271770.938010:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:1.0:1788271770.945053:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271770.945108:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271770.945206:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574315520 00000100:00100000:2.0:1788271770.945219:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574315520 00000100:00100000:2.0:1788271770.945291:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:2.0:1788271770.945302:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574315520:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:2.0:1788271770.945360:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.945386:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.945396:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788271770.945402:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271770.945407:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.945507:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271770.945544:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271770.945563:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875138586930048:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271770.945688:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271770.946163:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574315648 00000100:00100000:3.0:1788271770.946171:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574315648 00000100:00100000:3.0:1788271770.946228:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:3.0:1788271770.946239:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:2351:x1875138574315648:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271770.946254:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271770.946290:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f752e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238bb expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.946310:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:3.0:1788271770.946316:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271770.946363:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:2351:x1875138574315648:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 126us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271770.946372:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:2.0:1788271770.950402:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875138586930048:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271770.950501:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271770.950505:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271770.950752:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574315776 00000100:00100000:3.0:1788271770.950761:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574315776 00002000:00100000:3.0:1788271770.950829:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8ab6c57c0700 x1875138574315776/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:676/0 lens 504/0 e 0 to 0 dl 1788271781 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271770.950840:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6c57c0700 with x1875138574315776 ext(0->12) 00010000:00010000:3.0:1788271770.950848:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 8 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271770.950863:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 8 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271770.950871:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6c57c0700 00000100:00100000:3.0:1788271770.950907:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1788271770.950918:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574315776:12345-192.168.201.1@tcp:4:lfs.0 00000001:00100000:0.0:1788271770.985061:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000001:00080000:0.0:1788271771.027355:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788271771.027598:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574315776:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 76672us (77094us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788271771.027619:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00002000:00100000:1.0:1788271771.027636:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8ab6c57c0700 x1875138574315776/t4294967299(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:676/0 lens 504/448 e 0 to 0 dl 1788271781 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271771.027648:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6c57c0700 with x1875138574315776 ext(0->12) 00010000:00010000:1.0:1788271771.027660:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.027680:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271771.027690:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6c57c0700 00000100:00100000:1.0:1788271771.034101:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.034212:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574315904 00000100:00100000:0.0:1788271771.034225:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574315904 00010000:00010000:0.0:1788271771.034279:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271771.034331:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:0.0:1788271771.034343:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574315904:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271771.034360:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788271771.034386:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788271771.034389:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788271770 00002000:00010000:0.0:1788271771.034391:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788271770 00002000:00010000:0.0:1788271771.034393:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788271770 00002000:00010000:0.0:1788271771.034396:0:5823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788271771.034402:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.034470:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.034505:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7504 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x7693264610238a6 expref: 7 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.034527:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271771.034533:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271771.034540:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.034569:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.034602:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271771.034672:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574315904:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 331us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271771.034680:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00010000:00010000:3.0:1788271771.034933:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.034944:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.034982:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.034992:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.035038:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.035048:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271771.035053:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.035064:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.035081:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.035089:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090da890c/0xbeb05ca97b5f7551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.035160:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574315520:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 89859us (90121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271771.035169:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:1.0:1788271771.039243:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.039455:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574316160 00000100:00100000:2.0:1788271771.039470:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574316160 00000100:00100000:2.0:1788271771.039542:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1788271771.039556:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:10327:x1875138574316160:12345-192.168.201.1@tcp:35:lfs.0 00000004:00010000:2.0:1788271771.039647:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238c2 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271771.040021:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788271771.040062:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788271771.040812:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788271771.040865:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.040882:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 23 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.040905:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.040949:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 23 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.040967:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 23 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.040984:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875138586930176:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271771.041104:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271771.046066:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875138586930176:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271771.046108:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271771.047600:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.047933:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574316288 00000100:00100000:3.0:1788271771.047945:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574316288 00010000:00010000:3.0:1788271771.048085:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 24 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.048186:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:3.0:1788271771.048199:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:2354:x1875138574316288:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271771.048218:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271771.048226:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 24 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.048242:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 24 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.048268:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f74e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023898 expref: 24 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.048288:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:3.0:1788271771.048295:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.048306:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.048316:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.048371:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271771.048490:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:2354:x1875138574316288:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 293us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271771.048498:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00010000:00010000:0.0:1788271771.048627:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.048637:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271771.048805:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788271771.049069:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788271771.049195:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586930304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788271771.050587:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271771.050652:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271771.050981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586930304 00000100:00100000:1.0:1788271771.050995:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586930304 00000100:00100000:1.0:1788271771.051087:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271771.051114:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788271771.051123:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875138586930304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788271771.051124:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788271771.051274:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875138586930304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271771.051283:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271771.051594:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586930304:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788271771.051612:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788271771.052546:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788271771.052724:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586930432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788271771.052777:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271771.052804:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c11caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271771.052865:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586930432 00000100:00100000:2.0:1788271771.052876:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586930432 00000100:00100000:2.0:1788271771.052946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271771.052958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875138586930432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788271771.053295:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875138586930432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 339us (514us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788271771.053304:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271771.053496:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586930432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788271771.053573:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788271771.053622:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.053634:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.053643:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.053650:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271771.053657:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.053665:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.053684:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:3.0:1788271771.053688:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788271771.053694:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.053701:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7558 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271771.053983:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788271771.054210:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788271771.054223:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334235808713ns, next at 335235806301ns, rc = 0 00000001:00080000:3.0:1788271771.054230:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788271771.054267:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419000) 00010000:00010000:3.0:1788271771.054270:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788271771.054278:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7543 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238c2 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.054400:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:10327:x1875138574316160:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 14847us (15171us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788271771.054409:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000020:00080000:3.0:1788271771.054458:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788271771.058204:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.058316:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574316416 00000100:00100000:0.0:1788271771.058346:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574316416 00000100:00100000:0.0:1788271771.058526:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:0.0:1788271771.058538:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:10327:x1875138574316416:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271771.058574:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271771.058607:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f755f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.058691:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f755f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238c9 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.058709:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f755f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238c9 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.058732:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271771.058736:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271771.058741:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375e00, rc 0) 00000100:00100000:0.0:1788271771.058829:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:10327:x1875138574316416:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 293us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271771.058835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:2.0:1788271771.062198:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271771.062306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574316672 00000100:00100000:1.0:1788271771.062319:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574316672 00000100:00100000:1.0:1788271771.062553:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271771.062566:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:10327:x1875138574316672:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1788271771.066810:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:10327:x1875138574316672:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 4229us (4609us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788271771.066828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271771.123587:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.123716:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574316928 00000100:00100000:0.0:1788271771.123729:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574316928 00000100:00100000:1.0:1788271771.123878:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:1.0:1788271771.123895:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:10337:x1875138574316928:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271771.123927:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271771.123952:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f7566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238d0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271771.124116:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788271771.124255:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f7566 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238d0 expref: 30 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.124271:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:1.0:1788271771.124274:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271771.124278:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f7566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238d0 expref: 30 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.124310:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6000, rc 0) 00000100:00100000:1.0:1788271771.124383:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10337:x1875138574316928:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 492us (813us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788271771.124389:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:0.0:1788271771.127608:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.127689:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574317056 00000100:00100000:2.0:1788271771.127703:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574317056 00000100:00100000:2.0:1788271771.127774:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:2.0:1788271771.127786:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10337:x1875138574317056:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:2.0:1788271771.127891:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.127927:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.127938:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.127952:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.127956:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.127961:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128083:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128089:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128093:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271771.128137:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128149:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128153:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128167:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128172:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ae00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.128175:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128181:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128192:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271771.128195:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.128198:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128203:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128217:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128220:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128223:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128227:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.128229:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128238:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128243:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c4f64900) 00010000:00010000:2.0:1788271771.128245:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.128246:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128249:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f757b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128260:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128264:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128268:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128270:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.128272:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128275:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128278:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.128279:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.128281:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.128290:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.128372:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10337:x1875138574317056:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 587us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.128377:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:2.0:1788271771.130186:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.130250:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574317312 00000100:00100000:3.0:1788271771.130261:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574317312 00000100:00100000:3.0:1788271771.130324:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:3.0:1788271771.130336:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10337:x1875138574317312:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1788271771.130684:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:10337:x1875138574317312:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 348us (508us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788271771.130692:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1788271771.162772:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.162868:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574317568 00000100:00100000:0.0:1788271771.162892:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574317568 00000100:00100000:0.0:1788271771.162970:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:0.0:1788271771.162984:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:10340:x1875138574317568:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271771.163020:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271771.163050:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f7589 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238d7 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163168:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163184:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163196:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163210:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163216:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163220:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163367:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163372:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163376:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271771.163384:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788271771.163616:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163625:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163640:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163646:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271771.163650:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163655:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163667:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271771.163669:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271771.163673:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163678:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7590 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163690:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163693:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163696:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163700:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271771.163702:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163712:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163717:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c2fd1700) 00010000:00010000:0.0:1788271771.163718:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271771.163720:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163723:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163761:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f7589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 33 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163771:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 32 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.163775:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271771.163777:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271771.163778:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374600, rc 0) 00000100:00100000:0.0:1788271771.163857:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:10340:x1875138574317568:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 875us (1100us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788271771.163864:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:0.0:1788271771.166592:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.166687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574317696 00000100:00100000:3.0:1788271771.166700:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574317696 00000100:00100000:3.0:1788271771.166773:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:3.0:1788271771.166785:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:10340:x1875138574317696:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1788271771.166878:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.166918:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.166932:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.166967:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.166974:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.166982:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.166989:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271771.166994:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.167002:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.167015:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:3.0:1788271771.167019:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271771.167024:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.167031:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.167137:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:10340:x1875138574317696:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 353us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271771.167155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:2.0:1788271771.172700:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.172831:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574317952 00000100:00100000:0.0:1788271771.172848:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574317952 00000100:00100000:0.0:1788271771.172921:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1788271771.172933:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:10340:x1875138574317952:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271771.173293:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+33:10340:x1875138574317952:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 361us (613us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788271771.173303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1788271771.243018:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271771.243074:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.243510:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574318080 00000100:00100000:2.0:1788271771.243523:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574318080 00000100:00100000:2.0:1788271771.243597:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 282 00000100:00100000:2.0:1788271771.243610:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2352:x1875138574318080:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271771.243704:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2352:x1875138574318080:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 96us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.243712:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 282 00000100:00100000:0.0:1788271771.243866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574318208 00000100:00100000:0.0:1788271771.243871:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574318208 00000100:00080000:2.0:1788271771.243994:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271771.244129:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:0.0:1788271771.244139:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574318208:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271771.244179:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2352:x1875138574318208:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 42us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271771.244186:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:1.0:1788271771.381581:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.381639:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574318464 00000100:00100000:3.0:1788271771.381652:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574318464 00000100:00100000:3.0:1788271771.381734:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:3.0:1788271771.381747:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+33:10372:x1875138574318464:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:3.0:1788271771.381846:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271771.381875:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238de expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.382069:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f75ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.382088:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f75ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.382102:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f75ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271771.382115:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788271771.382342:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238de expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.382365:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f75ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238de expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.382375:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:3.0:1788271771.382379:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271771.382383:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19a00, rc 0) 00000100:00100000:3.0:1788271771.382688:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:10372:x1875138574318464:12345-192.168.201.1@tcp:101:cat.0 Request processed in 942us (1118us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788271771.382697:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:1.0:1788271771.388698:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271771.388790:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.388848:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574318848 00000100:00100000:3.0:1788271771.388863:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574318848 00000100:00100000:3.0:1788271771.388950:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1788271771.388962:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:2354:x1875138574318848:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271771.388993:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271771.389024:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f75ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238de expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.389047:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:3.0:1788271771.389054:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271771.389130:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:2354:x1875138574318848:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 169us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271771.389138:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:0.0:1788271771.390527:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574318720 00000100:00100000:0.0:1788271771.390541:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574318720 00000100:00100000:0.0:1788271771.390608:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:0.0:1788271771.390619:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:10372:x1875138574318720:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:0.0:1788271771.390947:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:10372:x1875138574318720:12345-192.168.201.1@tcp:35:cat.0 Request processed in 329us (2260us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788271771.390954:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:1.0:1788271771.446483:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.446599:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574319104 00000100:00100000:3.0:1788271771.446612:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574319104 00000100:00100000:3.0:1788271771.446680:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:3.0:1788271771.446691:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:10378:x1875138574319104:12345-192.168.201.1@tcp:101:dd.0 00010000:00010000:3.0:1788271771.446723:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271771.446727:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788271771.446773:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238b4 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.446800:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271771.446807:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271771.446843:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f75c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238e5 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.446970:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.446987:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 35 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.446996:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.447037:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 35 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.447052:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 35 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.447069:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586930560:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271771.447193:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7403c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271771.449771:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.449926:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586930560:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271771.449960:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.450074:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574319232 00000100:00100000:2.0:1788271771.450083:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574319232 00010000:00010000:2.0:1788271771.450126:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 36 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.450198:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:2.0:1788271771.450211:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:2353:x1875138574319232:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271771.450232:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271771.450241:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 36 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.450278:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 36 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.450307:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f759e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238d7 expref: 36 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.450327:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.450333:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.450344:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.450353:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.450390:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271771.450458:0:8302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.450466:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271771.450488:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:2.0:1788271771.450491:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:2353:x1875138574319232:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 283us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.450498:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00010000:00010000:1.0:1788271771.450950:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f75c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 36 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.451222:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 35 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.451233:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:1.0:1788271771.451236:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788271771.451239:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18400, rc 0) 00000100:00100000:1.0:1788271771.451284:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:10378:x1875138574319104:12345-192.168.201.1@tcp:101:dd.0 Request processed in 4594us (4886us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788271771.451292:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:1.0:1788271771.454343:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.454596:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574319488 00000100:00100000:2.0:1788271771.454610:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574319488 00000100:00100000:2.0:1788271771.454736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:2.0:1788271771.454749:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:10378:x1875138574319488:12345-192.168.201.1@tcp:36:dd.0 00010000:00010000:2.0:1788271771.455119:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.455143:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.455176:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271771.455238:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788271771.455264:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3f54e38 reply state 000000007693ec8f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.455275:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271771.455405:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:10378:x1875138574319488:12345-192.168.201.1@tcp:36:dd.0 Request processed in 649us (1067us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788271771.455458:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000020:00080000:2.0:1788271771.455465:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271771.457363:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.457385:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.457404:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.457456:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.457462:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.457471:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.457492:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.457496:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.457519:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.457527:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f75dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271771.634309:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.634473:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574319616 00000100:00100000:0.0:1788271771.634488:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574319616 00000100:00100000:0.0:1788271771.634573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:0.0:1788271771.634593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+37:10392:x1875138574319616:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:0.0:1788271771.634632:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271771.634663:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f75e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238ec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634752:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634771:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634783:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634800:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634808:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634815:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.634884:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271771.634960:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634973:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 38 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.634981:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.635035:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 38 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.635050:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 38 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271771.635065:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586930688:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271771.635183:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ca344240 going to sleep for 11 seconds 00000100:00100000:0.0:1788271771.639715:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586930688:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271771.639749:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271771.643157:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.643302:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574319872 00000100:00100000:3.0:1788271771.643315:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574319872 00000100:00100000:3.0:1788271771.643379:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271771.643391:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:5593:x1875138574319872:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788271771.644104:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+40:5593:x1875138574319872:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 713us (964us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788271771.644131:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271771.646591:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.646951:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574320000 00000100:00100000:0.0:1788271771.646964:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574320000 00010000:00010000:0.0:1788271771.647018:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 40 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271771.647180:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:0.0:1788271771.647190:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+40:2354:x1875138574320000:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271771.647206:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271771.647213:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 40 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.647225:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 40 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.647266:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f75cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238e5 expref: 40 pid: 8302 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.647282:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271771.647286:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.647294:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.647300:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.647326:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271771.647373:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647381:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271771.647401:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:2354:x1875138574320000:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 210us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271771.647407:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000004:00200000:2.0:1788271771.647504:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788271771.647510:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271771.647560:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647574:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647585:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647592:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647599:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647605:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.647610:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647628:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647638:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271771.647641:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.647645:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647651:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f75eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647663:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647668:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647675:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647680:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.647683:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647689:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647697:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c2fd1700) 00010000:00010000:2.0:1788271771.647699:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.647702:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647719:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f75f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647771:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f75e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238ec expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647786:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238ec expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.647794:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.647797:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271771.647800:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375400, rc 0) 00000100:00100000:2.0:1788271771.647847:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:10392:x1875138574319616:12345-192.168.201.1@tcp:101:stat.0 Request processed in 13257us (13554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.647856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:3.0:1788271771.705917:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.706277:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574320256 00000100:00100000:0.0:1788271771.706289:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574320256 00000100:00100000:0.0:1788271771.706401:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:0.0:1788271771.706466:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:10398:x1875138574320256:12345-192.168.201.1@tcp:36:truncate.0 00010000:00010000:0.0:1788271771.706536:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271771.706566:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f75f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238ec expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.706585:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271771.706589:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271771.706853:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.706866:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.706874:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271771.706949:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788271771.707086:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c040f26 reply state 000000003c8093ad transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271771.707095:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271771.707211:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+40:10398:x1875138574320256:12345-192.168.201.1@tcp:36:truncate.0 Request processed in 800us (1309us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788271771.707217:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000020:00080000:0.0:1788271771.707223:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788271771.708480:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.708496:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.708503:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.708510:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271771.708516:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.708524:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.708541:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:1.0:1788271771.708544:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271771.708549:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.708556:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7600 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.770135:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271771.770393:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574320384 00000100:00100000:1.0:1788271771.770406:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574320384 00000100:00100000:1.0:1788271771.770530:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:1.0:1788271771.770539:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:10412:x1875138574320384:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:1.0:1788271771.770572:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271771.770597:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238f3 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.770706:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.770727:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.770743:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.770768:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.770775:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.770782:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771074:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771084:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771092:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271771.771207:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788271771.771212:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271771.771236:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771256:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771263:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771268:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771273:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771277:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271771.771280:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771285:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771294:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:1.0:1788271771.771296:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271771.771300:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771304:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f760e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771314:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771318:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771326:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771329:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271771.771331:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771334:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771338:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6cb419c00) 00010000:00010000:1.0:1788271771.771339:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271771.771341:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771344:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771371:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 41 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771380:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 40 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.771384:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:1.0:1788271771.771386:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271771.771387:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7400, rc 0) 00000100:00100000:2.0:1788271771.772042:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+40:10412:x1875138574320384:12345-192.168.201.1@tcp:101:stat.0 Request processed in 1499us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.772053:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:3.0:1788271771.850333:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.850481:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574320640 00000100:00100000:2.0:1788271771.850494:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574320640 00000100:00100000:2.0:1788271771.850576:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:2.0:1788271771.850589:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+40:10422:x1875138574320640:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271771.850616:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271771.850644:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610238fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271771.850829:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788271771.850985:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7623 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238fa expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.851002:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:2.0:1788271771.851005:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271771.851012:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238fa expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.851033:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271771.851113:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:10422:x1875138574320640:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 527us (795us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788271771.851122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:1.0:1788271771.855221:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.855342:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574320896 00000100:00100000:0.0:1788271771.855356:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574320896 00000100:00100000:0.0:1788271771.855602:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1788271771.855615:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:10422:x1875138574320896:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271771.856001:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:10422:x1875138574320896:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 386us (793us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788271771.856010:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:3.0:1788271771.906552:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.906656:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574321152 00000100:00100000:2.0:1788271771.906670:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574321152 00000100:00100000:2.0:1788271771.906741:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1788271771.906752:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:10428:x1875138574321152:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271771.906779:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271771.906801:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7631 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023901 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.906919:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.906939:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 43 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.906973:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.907018:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 43 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.907033:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 43 pid: 8302 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.907050:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586930816:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271771.907166:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271771.909661:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.909770:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574321280 00000100:00100000:3.0:1788271771.909780:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574321280 00010000:00010000:3.0:1788271771.909820:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 44 pid: 8302 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.909860:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:3.0:1788271771.909869:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+44:2353:x1875138574321280:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271771.909884:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271771.909892:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 44 pid: 8302 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.909907:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 44 pid: 8302 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.909936:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:3.0:1788271771.909941:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.909950:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.909964:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.909987:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271771.910044:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+44:2353:x1875138574321280:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 176us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271771.910050:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00010000:00010000:2.0:1788271771.910542:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f761c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x7693264610238f3 expref: 43 pid: 8302 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.910560:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586930816:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271771.910583:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.910591:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.910595:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271771.910612:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788271771.910801:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7631 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.910827:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.910833:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.910835:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271771.910838:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ba00, rc 0) 00000100:00100000:2.0:1788271771.910874:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+43:10428:x1875138574321152:12345-192.168.201.1@tcp:101:bash.0 Request processed in 4125us (4336us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788271771.910880:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:1.0:1788271771.913182:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.913252:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574321536 00000100:00100000:2.0:1788271771.913263:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574321536 00000100:00100000:2.0:1788271771.913317:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:2.0:1788271771.913327:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+43:10428:x1875138574321536:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:2.0:1788271771.913667:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.913687:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.913700:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271771.913761:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788271771.913782:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007054393 reply state 00000000c00d8709 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.913790:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271771.913899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:10428:x1875138574321536:12345-192.168.201.1@tcp:36:bash.0 Request processed in 571us (728us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788271771.913907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000020:00080000:2.0:1788271771.913912:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271771.915342:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.915354:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.915360:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.915364:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.915367:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.915374:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.915391:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.915404:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.915444:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.915452:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7646 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271771.919046:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.919148:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574321664 00000100:00100000:3.0:1788271771.919159:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574321664 00000100:00100000:3.0:1788271771.919239:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:3.0:1788271771.919248:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:10428:x1875138574321664:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271771.919274:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271771.919295:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f764d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023908 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.919383:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.919399:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.919440:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.919484:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.919495:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 46 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271771.919508:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586930944:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271771.919614:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7403600 going to sleep for 11 seconds 00000100:00100000:3.0:1788271771.925152:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586930944:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271771.925187:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271771.925341:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.925838:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574321792 00000100:00100000:0.0:1788271771.925848:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574321792 00010000:00010000:0.0:1788271771.925948:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 47 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271771.926067:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:0.0:1788271771.926091:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:2353:x1875138574321792:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271771.926106:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271771.926112:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 47 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.926123:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 47 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.926145:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7638 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023901 expref: 47 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.926161:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271771.926166:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.926174:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.926179:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.926207:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271771.926258:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:2353:x1875138574321792:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 169us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271771.926263:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00010000:00010000:2.0:1788271771.926317:0:8302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.926323:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271771.926381:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788271771.926385:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271771.926444:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.926481:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f764d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023908 expref: 46 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.926493:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023908 expref: 45 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.926499:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.926501:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271771.926503:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19c00, rc 0) 00000100:00100000:2.0:1788271771.926524:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:10428:x1875138574321664:12345-192.168.201.1@tcp:101:bash.0 Request processed in 7279us (7491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.926529:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1788271771.928731:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.928817:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574322048 00000100:00100000:0.0:1788271771.928827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574322048 00000100:00100000:0.0:1788271771.928905:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1788271771.928915:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:10428:x1875138574322048:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:0.0:1788271771.929210:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:10428:x1875138574322048:12345-192.168.201.1@tcp:35:bash.0 Request processed in 297us (492us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788271771.929217:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1788271771.965780:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.965928:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574322304 00000100:00100000:2.0:1788271771.965941:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574322304 00000100:00100000:2.0:1788271771.966045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:2.0:1788271771.966055:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:10438:x1875138574322304:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271771.966084:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271771.966107:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f765b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102390f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271771.966238:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788271771.966384:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f765b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102390f expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.966455:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:2.0:1788271771.966459:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271771.966464:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f765b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x76932646102390f expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.966480:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ac00, rc 0) 00000100:00100000:2.0:1788271771.966535:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10438:x1875138574322304:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 482us (767us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788271771.966541:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:1.0:1788271771.968462:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.968589:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574322432 00000100:00100000:2.0:1788271771.968600:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574322432 00000100:00100000:2.0:1788271771.968695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:2.0:1788271771.968708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10438:x1875138574322432:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:2.0:1788271771.968796:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968811:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968821:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968833:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968838:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968860:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968971:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968977:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.968982:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271771.969023:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969034:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969047:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969053:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969058:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.969062:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969067:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969076:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271771.969082:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.969087:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969092:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7669 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969105:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969109:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969113:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969116:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.969118:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969121:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969124:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c4f64900) 00010000:00010000:2.0:1788271771.969125:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.969127:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969130:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969140:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969155:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969159:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969163:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.969164:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969168:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969172:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.969173:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271771.969175:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.969178:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.969248:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10438:x1875138574322432:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 543us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.969253:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:1.0:1788271771.971309:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271771.971406:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574322688 00000100:00100000:3.0:1788271771.971453:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574322688 00000100:00100000:3.0:1788271771.971542:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1788271771.971551:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10438:x1875138574322688:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1788271771.971822:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+48:10438:x1875138574322688:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 272us (520us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788271771.971828:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1788271771.987882:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.988093:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574322944 00000100:00100000:0.0:1788271771.988104:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574322944 00000100:00100000:0.0:1788271771.988210:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:0.0:1788271771.988221:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+48:10441:x1875138574322944:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271771.988249:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271771.988271:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f767e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023916 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.988349:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.988362:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.988370:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.988381:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.988385:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271771.988389:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.988866:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.988874:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.988998:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271771.989009:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788271771.989114:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989120:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989125:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989129:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271771.989133:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989138:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989173:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:1.0:1788271771.989175:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271771.989179:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989183:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989194:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989198:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989201:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989205:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271771.989206:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989210:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989213:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c2fd1e00) 00010000:00010000:1.0:1788271771.989214:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271771.989216:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989219:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f768c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989262:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f767e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023916 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989273:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023916 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271771.989278:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:1.0:1788271771.989279:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271771.989281:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6600, rc 0) 00000100:00100000:1.0:1788271771.989346:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10441:x1875138574322944:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1127us (1476us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788271771.989351:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:1.0:1788271771.991544:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271771.991636:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271771.991786:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574323200 00000100:00100000:2.0:1788271771.991797:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574323200 00000100:00100000:2.0:1788271771.991861:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:2.0:1788271771.991870:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10441:x1875138574323200:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:2.0:1788271771.991939:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.991967:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.991977:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.992003:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.992007:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.992013:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.992017:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271771.992021:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.992025:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.992033:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271771.992035:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271771.992038:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271771.992042:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271771.992136:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10441:x1875138574323200:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 267us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271771.992152:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:3.0:1788271771.992378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574323072 00000100:00100000:3.0:1788271771.992382:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574323072 00000100:00100000:3.0:1788271771.992458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1788271771.992467:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:2352:x1875138574323072:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271771.992480:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271771.992499:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023916 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271771.992511:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:3.0:1788271771.992515:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271771.992534:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:2352:x1875138574323072:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 70us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271771.992539:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1788271771.994208:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271771.994293:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574323456 00000100:00100000:0.0:1788271771.994305:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574323456 00000100:00100000:0.0:1788271771.994347:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1788271771.994355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:10441:x1875138574323456:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271771.994705:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10441:x1875138574323456:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 349us (504us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788271771.994711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1788271772.079043:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271772.079242:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574323712 00000100:00100000:2.0:1788271772.079253:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574323712 00000100:00100000:2.0:1788271772.079366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:2.0:1788271772.079380:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10459:x1875138574323712:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:2.0:1788271772.079472:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271772.079498:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102391d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.079628:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f76af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.079645:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f76af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.079660:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f76af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271772.079674:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788271772.079833:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102391d expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.079851:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f76af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102391d expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.079858:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:2.0:1788271772.079860:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788271772.079863:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a800, rc 0) 00000100:00100000:2.0:1788271772.079971:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10459:x1875138574323712:12345-192.168.201.1@tcp:101:cat.0 Request processed in 593us (940us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788271772.079979:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00080000:3.0:1788271772.080921:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271772.102639:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271772.102756:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574323840 00000100:00100000:2.0:1788271772.102767:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574323840 00000100:00100000:2.0:1788271772.102834:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:2.0:1788271772.102847:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10460:x1875138574323840:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271772.102880:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271772.102908:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023924 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.103016:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f76c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.103034:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.103048:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271772.103131:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788271772.103135:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271772.103175:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.103208:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f76bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023924 expref: 54 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.103230:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f76c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023924 expref: 53 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.103262:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271772.103266:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271772.103270:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271772.103349:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10460:x1875138574323840:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 505us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271772.103357:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:0.0:1788271772.108742:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271772.108832:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574324224 00000100:00100000:1.0:1788271772.108845:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574324224 00000100:00100000:1.0:1788271772.108912:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1788271772.108923:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10460:x1875138574324224:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1788271772.109451:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10460:x1875138574324224:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 484us (680us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788271772.109459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1788271772.111614:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271772.111702:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574324352 00000100:00100000:3.0:1788271772.111714:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574324352 00000100:00100000:3.0:1788271772.111786:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:3.0:1788271772.111798:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10460:x1875138574324352:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:3.0:1788271772.111816:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788271772.111848:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023908 expref: 54 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271772.111870:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f76af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102391d expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271772.111880:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f755f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610238c9 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271772.111892:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:3.0:1788271772.111905:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271772.111972:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:10460:x1875138574324352:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 175us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271772.111980:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1788271772.113493:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271772.113670:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574324480 00000100:00100000:1.0:1788271772.113698:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574324480 00000100:00100000:1.0:1788271772.113764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:1.0:1788271772.113773:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:10460:x1875138574324480:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:1.0:1788271772.113893:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271772.113912:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271772.113924:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271772.114493:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271772.114713:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788271772.114826:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788271772.114999:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:10460:x1875138574324480:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 1179us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271772.115008:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:0.0:1788271772.130181:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271772.130538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574324608 00000100:00100000:2.0:1788271772.130550:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574324608 00000100:00100000:2.0:1788271772.130651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:2.0:1788271772.130664:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:10462:x1875138574324608:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271772.130693:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271772.130720:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f76d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102392b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130803:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130816:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130825:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130837:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130842:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130860:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130988:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.130997:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131005:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271772.131044:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788271772.131048:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271772.131066:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131077:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131083:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131087:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131092:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131096:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ae00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271772.131099:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131110:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131122:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271772.131124:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271772.131128:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131133:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f76d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131154:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131159:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131163:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131166:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271772.131167:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131170:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131174:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c4f64900) 00010000:00010000:2.0:1788271772.131175:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271772.131177:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131187:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f76e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131215:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f76d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131225:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271772.131230:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419c00) 00010000:00010000:2.0:1788271772.131232:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271772.131233:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b800, rc 0) 00000100:00100000:2.0:1788271772.131302:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10462:x1875138574324608:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 642us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271772.131306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00010000:00010000:2.0:1788271772.658609:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271772.939774:0:11999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271772.939785:0:11999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271772.939827:0:11999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788271772.939833:0:11999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788271773.106799:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271773.106811:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271773.106895:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788271773.106905:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271773.107061:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eea7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586931072:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788271773.107191:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6caaa4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271773.117060:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eea7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586931072:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788271773.118905:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271773.118952:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574324736 00000100:00100000:1.0:1788271773.118962:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574324736 00000100:00100000:1.0:1788271773.119024:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:1.0:1788271773.119044:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10474:x1875138574324736:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788271773.119145:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10474:x1875138574324736:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 Request processed in 103us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.119154:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:3.0:1788271773.122463:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.122511:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574324864 00000100:00100000:3.0:1788271773.122523:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574324864 00000100:00100000:3.0:1788271773.122593:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:3.0:1788271773.122607:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10474:x1875138574324864:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788271773.122649:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788271773.122951:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10474:x1875138574324864:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 345us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.122966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:1.0:1788271773.135446:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.135612:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574324992 00000100:00100000:3.0:1788271773.135628:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574324992 00000100:00100000:3.0:1788271773.135717:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:3.0:1788271773.135786:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10474:x1875138574324992:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788271773.135897:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.135920:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.135939:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.135960:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.135967:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.135974:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136007:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136017:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136024:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271773.136093:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788271773.136099:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271773.136120:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136134:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136143:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136151:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136159:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271773.136165:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136173:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136190:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:3.0:1788271773.136193:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271773.136199:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136205:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f76ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136219:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136235:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136241:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136246:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271773.136250:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136256:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136264:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8ab6c3e3c000) 00010000:00010000:3.0:1788271773.136266:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271773.136269:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136276:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f76f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136294:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136300:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136305:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136311:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271773.136320:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136327:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136335:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419c00) 00010000:00010000:3.0:1788271773.136338:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271773.136341:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.136348:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f76fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271773.136551:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10474:x1875138574324992:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 820us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.136562:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:2.0:1788271773.141803:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.141929:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574325248 00000100:00100000:3.0:1788271773.141943:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574325248 00000100:00100000:3.0:1788271773.142014:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:3.0:1788271773.142026:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10474:x1875138574325248:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271773.142054:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271773.142080:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7703 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023932 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142219:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142238:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142264:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271773.142278:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788271773.142441:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142450:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142457:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142465:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271773.142470:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142477:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142492:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419c00) 00010000:00010000:3.0:1788271773.142496:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271773.142501:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142508:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f770a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142559:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7703 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023932 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142582:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:3.0:1788271773.142585:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271773.142589:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7703 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023932 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.142598:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19200, rc 0) 00000100:00100000:3.0:1788271773.142675:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10474:x1875138574325248:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 650us (884us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788271773.142684:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:3.0:1788271773.144871:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271773.144943:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574325376 00000100:00100000:2.0:1788271773.144954:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574325376 00000100:00100000:2.0:1788271773.145019:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:2.0:1788271773.145032:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10474:x1875138574325376:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788271773.145090:0:8302:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788271773.145218:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10474:x1875138574325376:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 187us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271773.145227:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:3.0:1788271773.148504:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271773.152073:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574325632 00000100:00100000:1.0:1788271773.152094:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574325632 00000100:00100000:1.0:1788271773.152234:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:1.0:1788271773.152246:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10474:x1875138574325632:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271773.152273:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271773.152277:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271773.152309:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f76c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023924 expref: 53 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.152331:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:1.0:1788271773.152336:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271773.152352:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7718 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023939 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271773.152987:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788271773.153270:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f771f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.153287:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.153299:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.153384:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7718 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023939 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.153447:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f771f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023939 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.153457:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6cb419400) 00010000:00010000:1.0:1788271773.153461:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271773.153464:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7e00, rc 0) 00000100:00100000:1.0:1788271773.153572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10474:x1875138574325632:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1326us (5078us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788271773.153583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:3.0:1788271773.163541:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.163764:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574325888 00000100:00100000:0.0:1788271773.163778:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574325888 00000100:00100000:0.0:1788271773.164786:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:0.0:1788271773.164806:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10474:x1875138574325888:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788271773.164901:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271773.164938:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f771f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023939 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.164961:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6cb419400) 00010000:00010000:0.0:1788271773.164975:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271773.165006:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165025:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165064:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165084:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165092:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165098:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165201:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165223:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165231:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165238:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271773.165243:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165251:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165261:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271773.165264:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271773.165268:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165280:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f772d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165291:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165297:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165314:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165319:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271773.165322:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165329:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165337:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc2b52984 (ffff8ab6c2fd1c00) 00010000:00010000:0.0:1788271773.165340:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271773.165342:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.165348:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7734 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc2b52984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.165717:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10474:x1875138574325888:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 917us (2187us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271773.165726:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:0.0:1788271773.173726:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.174288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574326016 00000100:00100000:3.0:1788271773.174303:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574326016 00000100:00100000:3.0:1788271773.174384:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:3.0:1788271773.174408:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10474:x1875138574326016:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271773.174474:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271773.174503:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f773b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023940 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.174549:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.174566:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.174580:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.174719:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f773b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.174740:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.174749:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271773.174752:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271773.174756:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18000, rc 0) 00000100:00100000:3.0:1788271773.174844:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10474:x1875138574326016:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 439us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.174852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:3.0:1788271773.176974:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271773.177136:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574326272 00000100:00100000:1.0:1788271773.177148:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574326272 00000100:00100000:1.0:1788271773.177233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:1.0:1788271773.177246:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10474:x1875138574326272:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788271773.177350:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.177370:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.177382:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271773.178813:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788271773.178827:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336360412893ns, next at 337360410805ns, rc = 0 00000004:00010000:1.0:1788271773.178974:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008914d910 reply state 00000000cc20b8e8 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271773.178987:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271773.179679:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10474:x1875138574326272:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 2430us (2711us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788271773.179688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 75 00010000:00010000:1.0:1788271773.187480:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.187503:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.187512:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.187520:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271773.187525:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.187534:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.187557:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:1.0:1788271773.187562:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788271773.187568:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.187575:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7749 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271773.187725:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271773.187796:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574326400 00000100:00100000:1.0:1788271773.187825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574326400 00000100:00100000:1.0:1788271773.187937:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:1.0:1788271773.187949:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10474:x1875138574326400:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271773.187980:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271773.188004:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023947 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.188079:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.188094:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.188117:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:1.0:1788271773.188121:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271773.188124:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7e00, rc 0) 00000100:00100000:1.0:1788271773.188200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10474:x1875138574326400:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 252us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.188219:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:2.0:1788271773.190992:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.191100:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574326528 00000100:00100000:0.0:1788271773.191113:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574326528 00000100:00100000:0.0:1788271773.191165:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:0.0:1788271773.191175:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875138574326528:12345-192.168.201.1@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788271773.191504:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:0.0:1788271773.191548:0:6697:0:(genops.c:1385:class_connect()) connect: client 896349b1-dd1e-47e2-bcd1-0ecd5d75458e, cookie 0xbeb05ca97b5f7757 00002000:00100000:0.0:1788271773.191565:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 896349b1-dd1e-47e2-bcd1-0ecd5d75458e/ffff8ab6f73f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271773.191812:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788271773.192347:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788271773.192402:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ab6f73f0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271773.192562:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2350:x1875138574326528:12345-192.168.201.1@tcp:8:lhsmtool_posix.0 Request processed in 1385us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271773.192571:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:0.0:1788271773.204605:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271773.204764:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574326656 00000100:00100000:2.0:1788271773.204779:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574326656 00000100:00080000:3.0:1788271773.204954:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271773.205037:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:2.0:1788271773.205051:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:0:x1875138574326656:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788271773.286459:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:0:x1875138574326656:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 81394us (81853us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788271773.286479:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000001:00100000:3.0:1788271773.286577:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000001:00080000:3.0:1788271773.286600:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1788271773.290281:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.290448:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574326912 00000100:00100000:3.0:1788271773.290461:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574326912 00000100:00100000:3.0:1788271773.290537:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1788271773.290550:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10474:x1875138574326912:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271773.290894:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10474:x1875138574326912:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 346us (629us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788271773.290904:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1788271773.295327:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271773.301484:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574327168 00000100:00100000:2.0:1788271773.301505:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574327168 00000100:00100000:2.0:1788271773.302191:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:2.0:1788271773.302210:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10474:x1875138574327168:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271773.302409:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10474:x1875138574327168:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 204us (7098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271773.302453:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:0.0:1788271773.310779:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271773.313296:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574327296 00000100:00100000:1.0:1788271773.313319:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574327296 00000100:00100000:1.0:1788271773.313438:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:1.0:1788271773.313453:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10474:x1875138574327296:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271773.313483:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271773.313515:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f775e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102394e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.313669:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.313687:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.313700:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271773.317302:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271773.317361:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.317451:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f775e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102394e expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.317480:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102394e expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.317491:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:1.0:1788271773.317494:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788271773.317499:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7800, rc 0) 00000100:00100000:1.0:1788271773.317604:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:10474:x1875138574327296:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 4153us (6838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.317615:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:2.0:1788271773.326242:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271773.329716:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574327424 00000100:00100000:1.0:1788271773.330011:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574327424 00000100:00100000:0.0:1788271773.339578:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:0.0:1788271773.339599:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2352:x1875138574327424:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271773.339637:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271773.339667:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023955 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788271773.339706:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dc9c, blocks: 0x1 00010000:00010000:0.0:1788271773.339890:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1788271773.339896:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271773.339926:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.340020:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.340038:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375a00, rc 0) 00000100:00100000:0.0:1788271773.340222:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574327424:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 628us (13996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271773.340231:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1788271773.346371:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.346550:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574327680 00000100:00100000:3.0:1788271773.346580:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574327680 00000100:00100000:3.0:1788271773.346661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:3.0:1788271773.346673:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:10474:x1875138574327680:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788271773.347585:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:10474:x1875138574327680:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 909us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.347597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:2.0:1788271773.354248:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.354875:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574327808 00000100:00100000:3.0:1788271773.354889:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574327808 00000100:00100000:3.0:1788271773.354967:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1788271773.354979:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:10474:x1875138574327808:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271773.355004:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271773.355033:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102395c expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.355082:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.355095:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271773.355100:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271773.355107:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.355154:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.355171:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 7 pid: 6700 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271773.355206:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875138586931200:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271773.355338:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c12edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271773.366024:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.366182:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574327936 00000100:00100000:0.0:1788271773.366195:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574327936 00010000:00010000:0.0:1788271773.366249:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 8 pid: 6700 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.366305:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:0.0:1788271773.366317:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574327936:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271773.366340:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271773.366371:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 8 pid: 6700 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.366400:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 8 pid: 6700 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.366477:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271773.366483:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271773.366512:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.366524:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.366575:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.366592:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875138586931328:192.168.201.1@tcp:105: 00000100:00100000:0.0:1788271773.366700:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ccf21600 going to sleep for 11 seconds 00010000:00010000:3.0:1788271773.366998:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f776c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023955 expref: 8 pid: 6700 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271773.367017:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875138586931200:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271773.367047:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.367073:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19200, rc 0) 00000100:00100000:3.0:1788271773.367112:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:10474:x1875138574327808:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 12134us (12879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.367121:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:0.0:1788271773.371772:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875138586931328:192.168.201.1@tcp:105: 00010000:00010000:0.0:1788271773.371825:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271773.371908:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574327936:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 5590us (5897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271773.371922:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:1.0:1788271773.377807:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.379127:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574328064 00000100:00100000:0.0:1788271773.379143:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574328064 00002000:00100000:0.0:1788271773.379207:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ab6eea7ad80 x1875138574328064/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:679/0 lens 504/0 e 0 to 0 dl 1788271784 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788271773.379219:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6eea7ad80 with x1875138574328064 ext(0->8) 00002000:00010000:0.0:1788271773.379227:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6eea7ad80 00000100:00100000:0.0:1788271773.379272:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:0.0:1788271773.379283:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574328064:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788271773.387664:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574328064:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 8369us (9857us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788271773.387690:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00002000:00100000:2.0:1788271773.387706:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ab6eea7ad80 x1875138574328064/t4294967302(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:679/0 lens 504/448 e 0 to 0 dl 1788271784 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271773.387718:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6eea7ad80 with x1875138574328064 ext(0->8) 00002000:00010000:2.0:1788271773.387726:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6eea7ad80 00000100:00100000:1.0:1788271773.396286:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.398506:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574328192 00000100:00100000:0.0:1788271773.398540:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574328192 00000100:00100000:0.0:1788271773.398621:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:0.0:1788271773.398632:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:10474:x1875138574328192:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788271773.443833:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:10474:x1875138574328192:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 45190us (47545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.443850:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00000001:00080000:3.0:1788271773.444027:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000020:00080000:3.0:1788271773.444056:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab6c9f9f9c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788271773.444061:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6c9fd2a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6c9f9f180 00000020:00080000:3.0:1788271773.444065:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6c9fd2b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6caa22c00 00000001:00080000:3.0:1788271773.444089:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788271773.444094:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788271773.444101:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000001:00080000:3.0:1788271773.444172:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788271773.444186:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788271773.444243:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788271773.444327:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586931456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788271773.444466:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586931584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788271773.444543:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271773.444753:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586931584 00000100:00100000:0.0:1788271773.444764:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586931584 00000100:00100000:0.0:1788271773.444874:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271773.444885:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586931584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788271773.445055:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788271773.445059:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788271772 00002000:00010000:0.0:1788271773.445061:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788271773.445063:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788271772 -> 1788271772 00002000:00010000:0.0:1788271773.445065:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788271773.445109:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586931584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (565us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788271773.445116:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1788271773.445164:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6ee0d7100/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788271773.445171:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586931584:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788271773.445216:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271773.446275:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271773.446502:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586931456 00000100:00100000:2.0:1788271773.446510:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586931456 00000100:00100000:1.0:1788271773.446524:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271773.446587:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574328320 00000100:00100000:2.0:1788271773.446592:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574328320 00000100:00100000:2.0:1788271773.446671:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271773.446684:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586931456:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788271773.446687:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788271773.446714:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00100000:0.0:1788271773.446725:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00002000:00010000:2.0:1788271773.446753:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a96dc9a, atime: 0x6a96dc9a, ctime: 0x6a96dc9a, blocks: 0xb 00010000:00010000:2.0:1788271773.446763:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.446783:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1788271773.446789:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1788271773.446793:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2352:x1875138574328320:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788271773.446811:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.446830:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.446843:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.446852:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.446879:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271773.447334:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271773.447342:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.447351:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271773.447356:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.447366:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.447399:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.447409:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d75292c8/0xbeb05ca97b5f777a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.447450:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271773.447452:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271773.447453:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271773.447618:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586931456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 936us (1343us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788271773.447627:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788271773.447680:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6edf4d180/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788271773.447687:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586931456:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788271773.473401:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788271773.473456:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788271773.473608:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574328320:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 26808us (27077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.473623:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:1.0:1788271773.479546:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.480268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574328576 00000100:00100000:3.0:1788271773.480283:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574328576 00000100:00100000:3.0:1788271773.480373:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:3.0:1788271773.480398:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10474:x1875138574328576:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271773.480497:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271773.480533:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102394e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.480559:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271773.480566:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271773.480610:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.480626:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.480636:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271773.480960:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5654ab9 reply state 00000000c6124090 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271773.480972:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271773.481102:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:10474:x1875138574328576:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 716us (1573us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788271773.481111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 81 00010000:00010000:3.0:1788271773.486006:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.486038:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.486047:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.486053:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00000100:00100000:1.0:1788271773.486057:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:3.0:1788271773.486059:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.486068:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.486090:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271773.486093:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271773.486099:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.486105:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7781 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.486536:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574328704 00000100:00100000:0.0:1788271773.486551:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574328704 00000100:00100000:0.0:1788271773.486626:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:0.0:1788271773.486638:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574328704:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788271773.486996:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788271773.487001:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788271772 -> 1788271771 00002000:00010000:0.0:1788271773.487022:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788271770 00002000:00010000:0.0:1788271773.487024:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788271772 -> 1788271771 00002000:00010000:0.0:1788271773.487026:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788271773.487936:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574328704:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 1292us (1877us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788271773.487950:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:1.0:1788271773.493670:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271773.494000:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574328960 00000100:00100000:2.0:1788271773.494014:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574328960 00000100:00100000:2.0:1788271773.494095:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:2.0:1788271773.494108:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10474:x1875138574328960:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788271773.494209:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.494230:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.494241:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.494286:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.494298:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 13 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271773.494313:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586931712:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271773.494464:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6de993f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271773.504529:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586931712:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271773.504581:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271773.507903:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.508007:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574329088 00000100:00100000:0.0:1788271773.508020:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574329088 00010000:00010000:0.0:1788271773.508077:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.508123:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:0.0:1788271773.508136:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2353:x1875138574329088:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271773.508164:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271773.508174:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.508192:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.508219:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023940 expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.508240:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:0.0:1788271773.508246:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.508256:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.508282:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.508324:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271773.508406:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:2353:x1875138574329088:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 271us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271773.508456:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00010000:00010000:2.0:1788271773.508552:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508573:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508609:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508617:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508625:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508632:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271773.508638:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508646:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508656:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:2.0:1788271773.508659:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788271773.508664:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.508670:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7788 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271773.508716:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:10474:x1875138574328960:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 14611us (15063us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788271773.508791:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:1.0:1788271773.513891:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.514248:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574329216 00000100:00100000:0.0:1788271773.514261:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574329216 00000100:00100000:0.0:1788271773.514407:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:0.0:1788271773.514448:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574329216:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788271773.514512:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.514539:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.514549:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271773.514554:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271773.514559:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.514609:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.514626:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 7 pid: 8463 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.514664:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586931840:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271773.514788:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788271773.519829:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.519950:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586931840:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271773.520004:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271773.520821:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574329344 00000100:00100000:2.0:1788271773.520833:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574329344 00010000:00010000:2.0:1788271773.520888:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 8 pid: 8463 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271773.520943:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:2.0:1788271773.520955:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574329344:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271773.520975:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271773.521015:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 8 pid: 8463 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.521032:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 8 pid: 8463 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.521069:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b57e9158/0xbeb05ca97b5f7773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x76932646102395c expref: 8 pid: 8463 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.521091:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271773.521096:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271773.521102:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.521113:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.521147:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271773.521225:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574329344:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 271us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271773.521253:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00010000:00010000:1.0:1788271773.522539:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522562:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522605:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522615:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522624:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522655:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375a00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271773.522661:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522671:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522693:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271773.522700:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f778f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271773.522804:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574329216:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 8355us (8925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.522818:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:1.0:1788271773.526138:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.526271:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574329600 00000100:00100000:3.0:1788271773.526286:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574329600 00000100:00100000:3.0:1788271773.526371:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:3.0:1788271773.526398:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:10474:x1875138574329600:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788271773.526539:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.526574:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.526611:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.528820:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.528850:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.528862:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.528920:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.528941:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 13 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.528960:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586931968:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271773.529083:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff370900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271773.538526:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.538637:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574329728 00000100:00100000:0.0:1788271773.538649:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574329728 00010000:00010000:0.0:1788271773.538707:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 14 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.538777:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:0.0:1788271773.538789:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2354:x1875138574329728:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271773.538809:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271773.538818:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 14 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.538834:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 14 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.538861:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:0.0:1788271773.538867:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.538878:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.538886:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.538909:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271773.538982:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2354:x1875138574329728:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 194us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271773.538991:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00010000:00010000:1.0:1788271773.544669:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023947 expref: 13 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271773.544705:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586931968:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271773.544746:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.546564:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.546585:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271773.546885:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788271773.547076:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788271773.547130:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788271773.547252:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1875138586932096:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788271773.547354:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271773.547778:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff3706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271773.548920:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586932096 00000100:00100000:1.0:1788271773.548955:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586932096 00000100:00100000:1.0:1788271773.549039:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271773.549053:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5837:x1875138586932096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788271773.549210:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5837:x1875138586932096:12345-0@lo:1000:mdt00_000.0 Request processed in 160us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.549218:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271773.549374:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788271773.549392:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6ee0d7100, transno 4294967303 00000100:00100000:0.0:1788271773.549437:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1875138586932096:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788271773.552013:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788271773.552143:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1875138586932224:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788271773.552235:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271773.552295:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff370840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271773.552497:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586932224 00000100:00100000:2.0:1788271773.552507:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586932224 00000100:00100000:2.0:1788271773.552584:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271773.552595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875138586932224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788271773.553367:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1875138586932224:12345-0@lo:1000:mdt00_000.0 Request processed in 771us (1129us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788271773.553391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271773.554002:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1875138586932224:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788271773.554060:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554073:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554082:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554089:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271773.554095:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554104:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554687:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:0.0:1788271773.554692:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271773.554698:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554705:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f779d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554815:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554824:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554831:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554836:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271773.554840:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554847:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554856:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419c00) 00010000:00010000:0.0:1788271773.554859:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271773.554862:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554868:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f76cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554943:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554962:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.554973:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.555020:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.555036:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 16 pid: 5837 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.555051:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586932352:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271773.555220:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff370b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271773.558068:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271773.558253:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586932352:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271773.558287:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271773.558673:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574329856 00000100:00100000:3.0:1788271773.558682:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574329856 00010000:00010000:3.0:1788271773.558727:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 17 pid: 5837 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271773.558813:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:3.0:1788271773.558825:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+17:2354:x1875138574329856:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271773.558844:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271773.558853:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 17 pid: 5837 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.558868:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 17 pid: 5837 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.558894:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f76e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x76932646102392b expref: 17 pid: 5837 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.558912:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419c00) 00010000:00010000:3.0:1788271773.558918:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.558928:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.558936:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.559009:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271773.559088:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:2354:x1875138574329856:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 263us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.559096:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00010000:00010000:0.0:1788271773.559709:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559719:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559733:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559751:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559758:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559765:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271773.559770:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559778:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559791:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419c00) 00010000:00010000:0.0:1788271773.559795:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271773.559800:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559805:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f77a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559818:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559824:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559829:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559834:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271773.559844:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559851:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559860:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419c00) 00010000:00010000:0.0:1788271773.559862:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271773.559865:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271773.559871:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7796 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271773.560243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:10474:x1875138574329600:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 33856us (34119us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788271773.560254:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 83 00000020:00080000:0.0:1788271773.560260:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788271773.560647:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271773.560653:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271773.560678:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788271773.560684:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788271773.566877:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271773.566977:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574330112 00000100:00100000:3.0:1788271773.566992:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574330112 00000100:00100000:3.0:1788271773.567153:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1788271773.567167:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:10474:x1875138574330112:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788271773.568117:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788271773.568249:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788271773.568307:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.568328:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.568343:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.568353:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.568360:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.568367:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271773.568405:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271773.568583:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+17:10474:x1875138574330112:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 1416us (1719us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788271773.568593:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000020:00080000:3.0:1788271773.568599:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271773.569783:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271773.569799:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.569810:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271773.569816:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.569825:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.569847:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab6c3e3c000) 00010000:00010000:2.0:1788271773.569851:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788271773.569857:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.569864:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f77ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271773.569915:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271773.569917:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271773.569919:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271773.683212:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586932864:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.683408:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271773.683514:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271773.683521:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586932736:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.683547:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.683547:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586932608:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.683587:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.683617:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586933120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271773.683646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.683667:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788271773.683673:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586932480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271773.683697:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271773.683731:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586932608 00000100:00100000:1.0:1788271773.683735:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586932992:0@lo:400:kworker.0 00000100:00100000:0.0:1788271773.683741:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586932608 00000100:00100000:1.0:1788271773.683765:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586933120 00000100:00100000:1.0:1788271773.683769:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586933120 00000100:00100000:1.0:1788271773.683795:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586932480 00000100:00100000:1.0:1788271773.683797:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586932480 00000100:00100000:0.0:1788271773.683798:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788271773.683810:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586932608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.683821:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788271773.683834:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875138586933120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271773.683852:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788271773.683873:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586932608:12345-0@lo:400:kworker.0 Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271773.683882:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788271773.683883:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875138586933120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.683911:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788271773.683919:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586932864 00000100:00100000:0.0:1788271773.683923:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586932864 00000100:00100000:1.0:1788271773.683932:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788271773.683939:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875138586932480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271773.683960:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788271773.683967:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586932864:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788271773.683968:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271773.683998:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586932864:12345-0@lo:400:kworker.0 Request processed in 31us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.684007:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875138586932480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271773.684011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788271773.684013:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788271773.684027:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271773.684073:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271773.684299:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586932864:0@lo:400:kworker.0 00000100:00100000:0.0:1788271773.684696:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271773.684984:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586932608:0@lo:400:kworker.0 00000100:00100000:0.0:1788271773.685008:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586933120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271773.685036:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586932480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271773.685125:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586932736 00000100:00100000:2.0:1788271773.685131:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586932736 00000100:00100000:2.0:1788271773.685398:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586932992 00000100:00100000:2.0:1788271773.685402:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586932992 00000100:00100000:1.0:1788271773.685494:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788271773.685506:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586932736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.685605:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586932736:12345-0@lo:400:kworker.0 Request processed in 100us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.685613:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788271773.685634:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788271773.685641:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.685677:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586932992:12345-0@lo:400:kworker.0 Request processed in 37us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.685683:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788271773.685712:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586932992:0@lo:400:kworker.0 00000100:00080000:3.0:1788271773.685777:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271773.685802:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586932736:0@lo:400:kworker.0 00010000:00010000:2.0:1788271774.708546:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271774.834804:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271774.834816:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271774.834858:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788271774.834863:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788271774.931591:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271774.932184:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574330368 00000100:00100000:0.0:1788271774.932198:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574330368 00000100:00100000:0.0:1788271774.932292:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:0.0:1788271774.932305:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+17:10491:x1875138574330368:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271774.932337:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271774.932376:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f77b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023963 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788271774.932380:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271774.932747:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f77b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.932765:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f77b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.933550:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f77b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271774.933574:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788271774.934693:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f77b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023963 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.934741:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f77b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023963 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.934753:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271774.934756:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788271774.934761:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374c00, rc 0) 00000100:00100000:0.0:1788271774.935953:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:10491:x1875138574330368:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 3644us (4367us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788271774.935968:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:0.0:1788271774.943567:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271774.943693:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574330496 00000100:00100000:1.0:1788271774.943706:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574330496 00000100:00100000:1.0:1788271774.943799:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:1.0:1788271774.943812:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:10491:x1875138574330496:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1788271774.943914:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.943950:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.943963:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.943981:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.943988:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.943995:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944407:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944453:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944461:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271774.944513:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944528:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944535:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944554:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944562:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271774.944567:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944576:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944592:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:1.0:1788271774.944595:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271774.944601:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944608:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f77c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944619:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944625:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944630:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944635:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271774.944639:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944654:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944663:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6cb419800) 00010000:00010000:1.0:1788271774.944666:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271774.944669:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944674:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f77ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944691:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944698:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944702:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944706:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271774.944708:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944711:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944715:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271774.944716:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271774.944718:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271774.944729:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f77d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271774.944814:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:10491:x1875138574330496:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 1004us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271774.944823:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:3.0:1788271774.997264:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271774.997383:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574330752 00000100:00100000:0.0:1788271774.997397:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574330752 00000100:00100000:0.0:1788271774.997505:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:0.0:1788271774.997518:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:10494:x1875138574330752:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271774.997548:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271774.997577:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f77dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102396a expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.997674:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.997693:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.997707:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.997746:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.997754:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.997761:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998216:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998228:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998237:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271774.998249:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788271774.998377:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998386:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998394:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998401:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271774.998407:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998455:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998471:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271774.998474:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271774.998479:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998486:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f77e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998500:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998506:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998513:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998519:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271774.998522:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998529:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998535:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c2fd1900) 00010000:00010000:0.0:1788271774.998538:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271774.998541:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998562:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f77ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998614:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f77dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 22 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998630:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 21 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271774.998638:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:0.0:1788271774.998640:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271774.998643:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375000, rc 0) 00000100:00100000:0.0:1788271774.998784:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10494:x1875138574330752:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1266us (1532us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788271774.998794:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:2.0:1788271775.019592:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.019716:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574330880 00000100:00100000:3.0:1788271775.019729:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574330880 00000100:00100000:3.0:1788271775.019806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:3.0:1788271775.019818:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10494:x1875138574330880:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1788271775.019916:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.019937:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.019962:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.019993:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.020000:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.020006:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.020012:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.020017:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.020025:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.020038:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:3.0:1788271775.020041:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271775.020047:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.020053:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f77ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.020140:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10494:x1875138574330880:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 323us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271775.020148:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:2.0:1788271775.027691:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.033931:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574331136 00000100:00100000:2.0:1788271775.033947:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574331136 00000100:00100000:2.0:1788271775.034017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:2.0:1788271775.034029:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10494:x1875138574331136:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271775.034336:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:10494:x1875138574331136:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 308us (6657us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788271775.034345:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:3.0:1788271775.089889:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271775.090156:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574331392 00000100:00100000:0.0:1788271775.090170:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574331392 00000100:00100000:0.0:1788271775.090249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:0.0:1788271775.090262:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:10015:x1875138574331392:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1788271775.090295:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271775.090324:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7806 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023971 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.090540:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.090559:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 23 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.090577:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.090621:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 23 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.090636:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 23 pid: 8302 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271775.090653:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586933248:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271775.090793:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271775.094052:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586933248:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271775.094097:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.094523:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271775.094865:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574331520 00000100:00100000:0.0:1788271775.094875:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574331520 00010000:00010000:0.0:1788271775.094933:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 24 pid: 8302 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271775.094981:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:0.0:1788271775.095087:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:2354:x1875138574331520:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271775.095108:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271775.095117:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 24 pid: 8302 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.095132:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 24 pid: 8302 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.095157:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f77f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x76932646102396a expref: 24 pid: 8302 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.095195:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:0.0:1788271775.095202:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.095213:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.095221:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.095253:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271775.095405:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.095435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271775.095459:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788271775.095659:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7806 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.095678:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.095686:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:3.0:1788271775.095689:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271775.095692:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374200, rc 0) 00000100:00100000:0.0:1788271775.095786:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:2354:x1875138574331520:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 793us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271775.095794:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:3.0:1788271775.101383:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:10015:x1875138574331392:12345-192.168.201.1@tcp:101:bash.0 Request processed in 11091us (11475us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788271775.101400:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:0.0:1788271775.126407:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.126549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574331776 00000100:00100000:3.0:1788271775.126562:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574331776 00000100:00100000:3.0:1788271775.126642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:3.0:1788271775.126655:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:10015:x1875138574331776:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:3.0:1788271775.127039:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.127079:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.127094:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271775.127161:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788271775.127188:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1c65c0f reply state 00000000b07b8a1d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.127198:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788271775.127247:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788271775.127388:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:10015:x1875138574331776:12345-192.168.201.1@tcp:36:bash.0 Request processed in 734us (995us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788271775.127396:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 89 00000020:00080000:3.0:1788271775.127402:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788271775.129344:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.129388:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.129397:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.129403:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271775.129444:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.129454:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.129475:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:1.0:1788271775.129478:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271775.129485:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.129492:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f781b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271775.132669:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.132794:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574331904 00000100:00100000:2.0:1788271775.132807:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574331904 00000100:00100000:2.0:1788271775.132882:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:2.0:1788271775.132894:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:10015:x1875138574331904:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271775.132935:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271775.132962:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7822 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023978 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.133054:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023978 expref: 27 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.133086:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023978 expref: 27 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.133114:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:2.0:1788271775.133117:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271775.133123:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ac00, rc 0) 00000100:00100000:2.0:1788271775.133200:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:10015:x1875138574331904:12345-192.168.201.1@tcp:101:bash.0 Request processed in 308us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271775.133208:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:0.0:1788271775.137572:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.137708:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574332032 00000100:00100000:1.0:1788271775.137744:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574332032 00000100:00100000:1.0:1788271775.137822:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:1.0:1788271775.137834:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:10015:x1875138574332032:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271775.137859:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271775.137886:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102397f expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271775.137932:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a96dc9b, atime: 0x6a96dc9a, ctime: 0x6a96dc9b, blocks: 0xb 00010000:00010000:1.0:1788271775.137960:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1788271775.137965:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271775.137974:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.138008:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.138023:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6200, rc 0) 00000100:00100000:1.0:1788271775.138097:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:10015:x1875138574332032:12345-192.168.201.1@tcp:101:bash.0 Request processed in 265us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271775.138104:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00080000:3.0:1788271775.138367:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271775.146331:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.146486:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574332160 00000100:00100000:1.0:1788271775.146500:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574332160 00002000:00010000:1.0:1788271775.146559:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788271775.146565:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ee0d7b80 with x1875138574332160 ext(0->18446744073709551615) 00002000:00010000:1.0:1788271775.146582:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6ee0d7b80. 00000100:00100000:1.0:1788271775.146626:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:1.0:1788271775.146638:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2351:x1875138574332160:12345-192.168.201.1@tcp:10:bash.0 00002000:00010000:1.0:1788271775.148394:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788271775.148405:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788271771 -> 1788271774 00002000:00010000:1.0:1788271775.148408:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788271770 -> 1788271770 00002000:00010000:1.0:1788271775.148432:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788271771 -> 1788271774 00002000:00010000:1.0:1788271775.148435:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788271775.148527:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2351:x1875138574332160:12345-192.168.201.1@tcp:10:bash.0 Request processed in 1884us (2205us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788271775.148538:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00002000:00010000:1.0:1788271775.148544:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788271775.148547:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ee0d7b80 with x1875138574332160 ext(0->18446744073709551615) 00002000:00010000:1.0:1788271775.148555:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6ee0d7b80. 00000100:00100000:1.0:1788271775.254117:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.254227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574332288 00000100:00100000:3.0:1788271775.254240:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574332288 00000100:00100000:3.0:1788271775.254324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:3.0:1788271775.254336:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:10508:x1875138574332288:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:3.0:1788271775.254520:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.254544:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.254558:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.254601:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.254609:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.254617:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255196:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255209:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255218:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271775.255269:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255283:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255290:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255298:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255305:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.255310:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255325:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255340:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271775.255344:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271775.255359:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255366:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255384:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255391:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255398:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255404:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.255407:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255467:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255475:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c3e3c700) 00010000:00010000:3.0:1788271775.255477:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271775.255481:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255496:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7837 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255514:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255522:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255529:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255534:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.255537:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255543:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255552:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:3.0:1788271775.255555:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271775.255558:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.255564:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f783e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.255673:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:10508:x1875138574332288:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 1337us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271775.255683:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:0.0:1788271775.300220:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.300343:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574332544 00000100:00100000:2.0:1788271775.300366:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574332544 00000100:00100000:2.0:1788271775.300590:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:2.0:1788271775.300605:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:10511:x1875138574332544:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271775.300633:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271775.300660:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7845 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023986 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.300767:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.300786:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.300810:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.300831:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.300859:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.300866:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301255:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f785a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301267:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f785a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301275:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f785a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271775.301287:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788271775.301865:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301878:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301885:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301892:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271775.301896:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301905:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301935:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271775.301939:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271775.301945:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301951:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f784c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301969:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301976:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301982:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301988:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271775.301992:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.301998:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.302007:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c4f64d00) 00010000:00010000:2.0:1788271775.302009:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271775.302013:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.302019:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.302088:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023986 expref: 30 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.302104:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f785a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023986 expref: 29 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.302112:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:2.0:1788271775.302114:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271775.302117:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ae00, rc 0) 00000100:00100000:2.0:1788271775.302213:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10511:x1875138574332544:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1611us (2007us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788271775.302222:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:1.0:1788271775.306663:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.306863:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574332672 00000100:00100000:3.0:1788271775.306877:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574332672 00000100:00100000:3.0:1788271775.307074:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:3.0:1788271775.307090:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10511:x1875138574332672:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1788271775.307197:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.307220:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.307232:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.307279:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.307298:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 29 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.307316:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586933376:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271775.307522:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c12edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271775.310178:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586933376:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271775.310226:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271775.312655:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.313840:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574332928 00000100:00100000:2.0:1788271775.313857:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574332928 00000100:00100000:2.0:1788271775.314114:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:2.0:1788271775.314129:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:5594:x1875138574332928:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788271775.314654:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+31:5594:x1875138574332928:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 525us (2011us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788271775.314666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:1.0:1788271775.318086:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.318308:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574333056 00000100:00100000:2.0:1788271775.318322:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574333056 00010000:00010000:2.0:1788271775.318391:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 31 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271775.318500:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:2.0:1788271775.318514:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+31:2352:x1875138574333056:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271775.318558:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271775.318568:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 31 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.318587:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 31 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.318620:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f780d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023971 expref: 31 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.318642:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:2.0:1788271775.318650:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.318663:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.318672:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.318717:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271775.319123:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:2352:x1875138574333056:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 611us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271775.319132:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00010000:00010000:1.0:1788271775.319223:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319233:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319275:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319282:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319289:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319307:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271775.319313:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319323:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319334:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:1.0:1788271775.319337:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271775.319341:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.319346:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271775.319484:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10511:x1875138574332672:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 12398us (12837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271775.319495:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:0.0:1788271775.324265:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.324404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574333312 00000100:00100000:3.0:1788271775.324476:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574333312 00000100:00100000:3.0:1788271775.324572:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:3.0:1788271775.324592:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:10511:x1875138574333312:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1788271775.325148:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:10511:x1875138574333312:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 559us (907us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788271775.325166:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:0.0:1788271775.446405:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.446560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574333568 00000100:00100000:3.0:1788271775.446573:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574333568 00000100:00100000:3.0:1788271775.446657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:3.0:1788271775.446670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:10522:x1875138574333568:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:3.0:1788271775.446704:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271775.446732:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f786f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102398d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.446813:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.446828:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.446838:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.446854:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.446858:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.446865:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447220:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447238:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447246:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271775.447256:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788271775.447370:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447385:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447392:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447399:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.447404:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447458:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447471:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271775.447474:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271775.447479:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447484:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447496:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447505:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447509:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447512:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.447514:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447517:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447522:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c3e3c700) 00010000:00010000:3.0:1788271775.447524:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271775.447526:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447529:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f787d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447568:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f786f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102398d expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447577:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x76932646102398d expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.447581:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:3.0:1788271775.447583:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271775.447589:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18800, rc 0) 00000100:00100000:3.0:1788271775.447651:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:10522:x1875138574333568:12345-192.168.201.1@tcp:101:cat.0 Request processed in 984us (1262us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788271775.447658:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:1.0:1788271775.453335:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.453404:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574333824 00000100:00100000:2.0:1788271775.453448:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574333824 00000100:00100000:2.0:1788271775.453508:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:2.0:1788271775.453516:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:10522:x1875138574333824:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:2.0:1788271775.454408:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+33:10522:x1875138574333824:12345-192.168.201.1@tcp:35:cat.0 Request processed in 887us (1084us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788271775.454452:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:0.0:1788271775.480920:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.481007:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574334080 00000100:00100000:2.0:1788271775.481021:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574334080 00000100:00100000:2.0:1788271775.481191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00100000:2.0:1788271775.481204:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+33:10523:x1875138574334080:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:2.0:1788271775.481286:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788271775.481322:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102398d expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481488:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f785a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023986 expref: 32 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481506:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7822 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023978 expref: 31 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481519:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:2.0:1788271775.481532:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271775.481563:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481579:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481592:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481754:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481763:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.481771:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.482406:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.482464:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.482473:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271775.484553:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788271775.484574:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338666160078ns, next at 339666155825ns, rc = 0 00010000:00010000:2.0:1788271775.485158:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485245:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485261:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485272:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485298:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485305:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485569:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271775.485603:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485677:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485685:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485701:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271775.485707:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485715:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485738:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271775.485741:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788271775.485746:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485752:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.485782:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.486009:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.486015:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.486020:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271775.486024:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.486029:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.486039:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271775.486041:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271775.486045:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.486051:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7892 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271775.486067:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007363fcbe reply state 00000000c64215ee transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271775.486077:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271775.486627:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:10523:x1875138574334080:12345-192.168.201.1@tcp:36:rm.0 Request processed in 5410us (5708us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788271775.486639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 95 00010000:00010000:0.0:1788271775.488058:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271775.488075:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.488087:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271775.488473:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.488504:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.488525:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:0.0:1788271775.488528:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788271775.488533:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.488539:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f78a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.488569:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271775.488571:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271775.488572:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271775.489407:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.489517:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.489526:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.489532:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.489537:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.489545:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.489560:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c4f64d00) 00010000:00010000:3.0:1788271775.489564:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271775.489568:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.489573:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7899 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271775.532821:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.533031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574334336 00000100:00100000:3.0:1788271775.533046:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574334336 00000100:00100000:3.0:1788271775.533119:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:3.0:1788271775.533132:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+31:10529:x1875138574334336:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271775.533671:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271775.533703:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f78ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023994 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.534011:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.534031:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.534045:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.534062:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.534069:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.534075:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271775.537410:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788271775.537756:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537779:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537796:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537869:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537877:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537885:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537892:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271775.537897:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537906:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537921:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271775.537925:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271775.537931:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.537938:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f78b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271775.537955:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfe6c5de reply state 00000000aedd0022 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.537967:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788271775.538010:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f78ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.538041:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.538049:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:3.0:1788271775.538052:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271775.538054:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19c00, rc 0) 00000100:00100000:3.0:1788271775.538165:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:10529:x1875138574334336:12345-192.168.201.1@tcp:101:bash.0 Request processed in 5035us (5359us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788271775.538176:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:0.0:1788271775.543510:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:1.0:1788271775.543807:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.543823:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.543833:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.543841:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271775.543847:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.543871:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.543893:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c3e3c700) 00010000:00010000:1.0:1788271775.543897:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271775.543902:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.543909:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f78bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.543998:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574334464 00000100:00100000:3.0:1788271775.544011:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574334464 00000100:00100000:3.0:1788271775.544102:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:3.0:1788271775.544115:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574334464:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271775.544139:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271775.544162:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x76932646102399b expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271775.544194:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788271775.544223:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1788271775.544228:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271775.544238:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 6 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.544258:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 6 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.544285:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18c00, rc 0) 00000100:00080000:0.0:1788271775.544289:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271775.544385:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2351:x1875138574334464:12345-192.168.201.1@tcp:101:bash.0 Request processed in 272us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271775.544393:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:1.0:1788271775.547556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.547797:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574334592 00000100:00100000:3.0:1788271775.547810:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574334592 00000100:00100000:3.0:1788271775.547878:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:3.0:1788271775.547890:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:10529:x1875138574334592:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271775.547922:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271775.547946:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239a2 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.547986:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.547998:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271775.548003:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271775.548009:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.548053:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.548069:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 7 pid: 8463 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.548110:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875138586933504:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271775.548231:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c12edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271775.551747:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.551875:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574334720 00000100:00100000:1.0:1788271775.551887:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574334720 00010000:00010000:1.0:1788271775.551943:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 8 pid: 8463 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271775.552000:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:1.0:1788271775.552012:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574334720:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271775.552032:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788271775.552039:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875138586933504:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271775.552063:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 8 pid: 8463 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.552079:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 8 pid: 8463 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.552222:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.552247:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19000, rc 0) 00000100:00100000:3.0:1788271775.552477:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:10529:x1875138574334592:12345-192.168.201.1@tcp:101:bash.0 Request processed in 4588us (4934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271775.552485:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00010000:00010000:1.0:1788271775.555815:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063f17037/0xbeb05ca97b5f78d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x76932646102399b expref: 7 pid: 8463 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.555869:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271775.555875:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271775.555886:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.555898:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.555969:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271775.555991:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1875138586933632:192.168.201.1@tcp:105: 00000100:00100000:1.0:1788271775.556127:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271775.559483:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1875138586933632:192.168.201.1@tcp:105: 00010000:00010000:1.0:1788271775.559533:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271775.559600:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574334720:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 7589us (7866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271775.559615:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1788271775.562067:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.562155:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574334976 00000100:00100000:3.0:1788271775.562170:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574334976 00000100:00100000:3.0:1788271775.562240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:3.0:1788271775.562252:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+33:10529:x1875138574334976:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:3.0:1788271775.563188:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:10529:x1875138574334976:12345-192.168.201.1@tcp:35:bash.0 Request processed in 934us (1129us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788271775.563200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:0.0:1788271775.694037:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.694483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574335104 00000100:00100000:1.0:1788271775.694497:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574335104 00000100:00100000:1.0:1788271775.694579:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:1.0:1788271775.694595:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:10545:x1875138574335104:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271775.694633:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271775.694668:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f78df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.695115:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f78e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.695134:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.695147:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271775.695227:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788271775.695232:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271775.695258:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.695291:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f78df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239a9 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.695395:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f78e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239a9 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.695408:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:1.0:1788271775.695464:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271775.695469:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7a00, rc 0) 00000100:00100000:1.0:1788271775.695620:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:10545:x1875138574335104:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1028us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271775.695628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:0.0:1788271775.701830:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.702570:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574335360 00000100:00100000:2.0:1788271775.702585:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574335360 00000100:00100000:2.0:1788271775.702784:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:2.0:1788271775.702797:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:10545:x1875138574335360:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271775.702826:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271775.702851:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f78ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239b0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.702999:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.703017:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.703032:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271775.703046:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788271775.703204:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f78ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239b0 expref: 38 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.703229:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239b0 expref: 37 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.703239:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:2.0:1788271775.703242:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271775.703246:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ba00, rc 0) 00000100:00100000:2.0:1788271775.703335:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+37:10545:x1875138574335360:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 540us (1519us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788271775.703353:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:0.0:1788271775.708749:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271775.708829:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.708904:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574335744 00000100:00100000:1.0:1788271775.708916:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574335744 00000100:00100000:1.0:1788271775.709018:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:1.0:1788271775.709031:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+37:2351:x1875138574335744:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271775.709051:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271775.709082:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f78f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239b0 expref: 37 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.709106:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:1.0:1788271775.709113:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271775.709179:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:2351:x1875138574335744:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 151us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271775.709188:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1788271775.714763:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574335616 00000100:00100000:2.0:1788271775.714810:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574335616 00000100:00100000:2.0:1788271775.715124:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:2.0:1788271775.715138:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:10545:x1875138574335616:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271775.715173:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271775.715202:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7902 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.715349:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7909 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.715367:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.715382:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271775.715397:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788271775.715652:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239b7 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.715677:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7909 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239b7 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.715698:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:2.0:1788271775.715701:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788271775.715706:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ae00, rc 0) 00000100:00100000:2.0:1788271775.715800:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:10545:x1875138574335616:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 664us (7494us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788271775.715808:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:0.0:1788271775.725693:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.725804:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574335872 00000100:00100000:1.0:1788271775.725817:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574335872 00000100:00100000:1.0:1788271775.725935:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:1.0:1788271775.725949:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574335872:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:1.0:1788271775.726014:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.726043:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.726053:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271775.726059:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271775.726065:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.726112:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.726138:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 6 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271775.726158:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1875138586933760:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271775.726323:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271775.730382:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.731092:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1875138586933760:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271775.731133:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271775.731463:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574336000 00000100:00100000:2.0:1788271775.731472:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574336000 00002000:00100000:2.0:1788271775.731541:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ab6ff9c1880 x1875138574336000/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:681/0 lens 504/0 e 0 to 0 dl 1788271786 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271775.731551:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ff9c1880 with x1875138574336000 ext(0->8) 00010000:00010000:2.0:1788271775.731559:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 7 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.731578:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 7 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271775.731586:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6ff9c1880 00000100:00100000:2.0:1788271775.731629:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:2.0:1788271775.731643:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574336000:12345-192.168.201.1@tcp:4:lfs.0 00000100:00100000:2.0:1788271775.732255:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2353:x1875138574336000:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 613us (1886us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788271775.732267:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00002000:00100000:2.0:1788271775.732275:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ab6ff9c1880 x1875138574336000/t4294967302(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:681/0 lens 504/448 e 0 to 0 dl 1788271786 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271775.732284:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ff9c1880 with x1875138574336000 ext(0->8) 00010000:00010000:2.0:1788271775.732290:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 9 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.732304:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 9 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271775.732322:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6ff9c1880 00010000:00010000:2.0:1788271775.733792:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271775.735167:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.735853:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574336128 00000100:00100000:1.0:1788271775.735867:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574336128 00010000:00010000:1.0:1788271775.735923:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 9 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271775.735976:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:1.0:1788271775.735988:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574336128:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271775.736009:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788271775.736033:0:8506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788271775.736036:0:8506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788271774 00002000:00010000:1.0:1788271775.736039:0:8506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788271775 00002000:00010000:1.0:1788271775.736041:0:8506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788271774 00010000:00010000:1.0:1788271775.736048:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 9 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.736092:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 9 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.736123:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f78d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x7693264610239a2 expref: 9 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.736145:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271775.736150:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271775.736157:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.736168:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.736207:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271775.736283:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574336128:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 296us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271775.736291:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00010000:00010000:0.0:1788271775.736409:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736473:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736502:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736511:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736520:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736528:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271775.736534:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736542:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736557:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.736565:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbae8350/0xbeb05ca97b5f7917 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271775.736630:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574335872:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 10685us (10953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271775.736639:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:0.0:1788271775.739055:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.739155:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574336384 00000100:00100000:2.0:1788271775.739168:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574336384 00000100:00100000:2.0:1788271775.739232:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1788271775.739244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:10545:x1875138574336384:12345-192.168.201.1@tcp:35:lfs.0 00000004:00010000:2.0:1788271775.739518:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7909 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239b7 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271775.739901:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788271775.739949:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788271775.741622:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788271775.741723:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.741745:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.741757:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.741809:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.741828:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 42 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271775.741845:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875138586933888:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271775.741987:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c1254300 going to sleep for 11 seconds 00000100:00100000:2.0:1788271775.755318:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.755456:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574336512 00000100:00100000:3.0:1788271775.755470:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574336512 00000100:00100000:1.0:1788271775.755499:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875138586933888:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271775.755536:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 43 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.755544:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271775.755575:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:3.0:1788271775.755587:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+43:2353:x1875138574336512:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271775.755629:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271775.755638:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 43 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.755653:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 43 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.755681:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f78c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023994 expref: 43 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.755703:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:3.0:1788271775.755709:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.755721:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.755730:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.755764:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271775.755838:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:2353:x1875138574336512:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 252us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271775.755847:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00010000:00010000:1.0:1788271775.756635:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.756646:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271775.756855:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788271775.757133:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788271775.757269:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586934016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788271775.757360:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271775.758325:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586934016 00000100:00100000:2.0:1788271775.758339:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586934016 00000100:00100000:2.0:1788271775.758478:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271775.758491:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1875138586934016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788271775.758621:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271775.759069:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1875138586934016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 579us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271775.759079:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271775.760518:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff2649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271775.760579:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586934016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788271775.761274:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788271775.761404:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff9c2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586934144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788271775.761527:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271775.761635:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271775.762786:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586934144 00000100:00100000:2.0:1788271775.762802:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586934144 00000100:00100000:0.0:1788271775.762940:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271775.762954:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5841:x1875138586934144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788271775.763274:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5841:x1875138586934144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 322us (1746us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788271775.763282:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271775.763937:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff9c2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586934144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788271775.764050:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788271775.764108:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.764120:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.764128:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.764133:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271775.764139:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.764148:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.764170:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:2.0:1788271775.764172:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788271775.764176:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.764202:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f791e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788271775.764490:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788271775.764603:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788271775.764614:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338946199715ns, next at 339946197453ns, rc = 0 00000001:00080000:2.0:1788271775.764618:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788271775.764645:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3c600) 00010000:00010000:2.0:1788271775.764647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788271775.764654:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7909 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239b7 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271775.764781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:10545:x1875138574336384:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 25539us (25739us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788271775.764789:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000020:00080000:2.0:1788271775.764793:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788271775.769549:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.769622:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574336640 00000100:00100000:3.0:1788271775.769637:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574336640 00000100:00100000:3.0:1788271775.769718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:3.0:1788271775.769730:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:10545:x1875138574336640:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271775.769783:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271775.769815:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.770468:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239be expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271775.770490:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239be expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.770603:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271775.770608:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271775.770611:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19c00, rc 0) 00000100:00100000:0.0:1788271775.770688:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:10545:x1875138574336640:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 959us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271775.770710:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:0.0:1788271775.775224:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271775.775305:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574336896 00000100:00100000:3.0:1788271775.775328:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574336896 00000100:00100000:3.0:1788271775.775443:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1788271775.775456:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:10545:x1875138574336896:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271775.776303:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10545:x1875138574336896:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 847us (1092us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788271775.776315:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:2.0:1788271775.869567:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271775.869769:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574337024 00000100:00100000:1.0:1788271775.869782:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574337024 00000100:00100000:1.0:1788271775.869869:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:1.0:1788271775.869882:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10555:x1875138574337024:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1788271775.870003:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870026:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870043:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870062:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870070:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870078:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870214:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870222:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870248:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271775.870303:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870319:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870326:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870333:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870350:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271775.870356:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870365:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870380:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:1.0:1788271775.870384:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271775.870389:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870396:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f792c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870460:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870474:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870481:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870486:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271775.870489:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870495:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870504:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6cb419100) 00010000:00010000:1.0:1788271775.870506:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271775.870509:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870515:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f7933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870530:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870536:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870542:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870547:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271775.870556:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870562:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870570:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:1.0:1788271775.870573:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271775.870575:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271775.870581:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f793a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271775.870678:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10555:x1875138574337024:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 797us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271775.870688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:2.0:1788271775.916743:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271775.916982:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574337280 00000100:00100000:0.0:1788271775.916997:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574337280 00000100:00100000:0.0:1788271775.917079:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:0.0:1788271775.917090:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:10558:x1875138574337280:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271775.917121:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271775.917147:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7941 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239c5 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917293:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917308:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917321:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917356:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917365:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917372:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917747:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917753:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917759:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271775.917767:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788271775.917870:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917875:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917880:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917885:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271775.917888:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917893:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917903:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271775.917905:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271775.917908:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917921:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917933:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917936:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917940:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917943:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271775.917945:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917950:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917956:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c2fd1900) 00010000:00010000:0.0:1788271775.917959:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271775.917962:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.917967:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f794f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.918014:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7941 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 50 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.918026:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 49 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271775.918037:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271775.918039:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271775.918041:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374400, rc 0) 00000100:00100000:0.0:1788271775.918155:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:10558:x1875138574337280:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1067us (1426us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788271775.918161:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:0.0:1788271775.930445:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271775.930908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574337408 00000100:00100000:2.0:1788271775.930923:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574337408 00000100:00100000:2.0:1788271775.931010:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:2.0:1788271775.931023:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:10558:x1875138574337408:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:2.0:1788271775.931120:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931142:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931180:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931233:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931241:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931248:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931255:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271775.931260:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931268:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931285:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:2.0:1788271775.931289:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271775.931295:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271775.931301:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271775.931408:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:10558:x1875138574337408:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 387us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271775.931448:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:2.0:1788271775.935109:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271775.935228:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574337664 00000100:00100000:0.0:1788271775.935242:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574337664 00000100:00100000:0.0:1788271775.935381:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:0.0:1788271775.935395:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:10558:x1875138574337664:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271775.935758:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10558:x1875138574337664:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 366us (662us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788271775.935768:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:0.0:1788271776.018755:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.018914:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574337920 00000100:00100000:2.0:1788271776.018926:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574337920 00000100:00100000:2.0:1788271776.019025:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:2.0:1788271776.019037:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10568:x1875138574337920:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271776.019065:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.019068:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788271776.019100:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f78e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239a9 expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.019120:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271776.019124:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271776.019137:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f796b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239cc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.019260:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.019275:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 50 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.019284:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.019347:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 50 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.019363:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 50 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.019406:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eea7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586934272:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271776.019598:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292780 going to sleep for 11 seconds 00000100:00080000:0.0:1788271776.021136:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271776.023790:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.023893:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574338048 00000100:00100000:0.0:1788271776.023905:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574338048 00010000:00010000:0.0:1788271776.023956:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 51 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271776.024007:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:0.0:1788271776.024019:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:2354:x1875138574338048:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271776.024038:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271776.024046:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 51 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.024079:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 51 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.024107:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271776.024114:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.024126:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.024135:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.024156:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271776.024239:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:2354:x1875138574338048:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 221us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.024247:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00010000:00010000:2.0:1788271776.025209:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7956 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239c5 expref: 50 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.025232:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eea7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586934272:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271776.025264:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.025274:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.025279:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.025304:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788271776.026157:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f796b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.026179:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.026196:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:2.0:1788271776.026199:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271776.026203:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b000, rc 0) 00000100:00100000:2.0:1788271776.026280:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10568:x1875138574337920:12345-192.168.201.1@tcp:101:bash.0 Request processed in 7244us (7538us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788271776.026317:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:1.0:1788271776.035771:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.035977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574338304 00000100:00100000:2.0:1788271776.035991:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574338304 00000100:00100000:2.0:1788271776.036068:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 105 00000100:00100000:2.0:1788271776.036080:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:10568:x1875138574338304:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:2.0:1788271776.037812:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.037843:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.037857:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271776.037963:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788271776.037992:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e98bf73e reply state 000000005229a241 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.038002:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271776.038153:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10568:x1875138574338304:12345-192.168.201.1@tcp:36:bash.0 Request processed in 2070us (2393us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788271776.038164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 105 00000020:00080000:2.0:1788271776.038170:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788271776.040950:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.040973:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.040983:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.040991:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271776.040997:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.041011:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.041063:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:3.0:1788271776.041066:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271776.041072:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.041078:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7980 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271776.041664:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.041752:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574338432 00000100:00100000:2.0:1788271776.041766:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574338432 00000100:00100000:2.0:1788271776.041844:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:2.0:1788271776.041857:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10568:x1875138574338432:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271776.041889:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.041922:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239d3 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.042046:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.042061:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.042071:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.042113:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.042130:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 53 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.042144:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eea7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586934400:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271776.042253:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271776.044474:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.044643:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eea7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586934400:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271776.044674:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.045066:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574338560 00000100:00100000:3.0:1788271776.045076:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574338560 00010000:00010000:3.0:1788271776.045121:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 54 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.045167:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:3.0:1788271776.045181:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:2354:x1875138574338560:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271776.045199:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271776.045206:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 54 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.045220:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 54 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.045246:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7972 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239cc expref: 54 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.045265:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:3.0:1788271776.045270:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.045297:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.045306:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.045350:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271776.045440:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:2354:x1875138574338560:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 262us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.045449:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00010000:00010000:2.0:1788271776.045527:0:8302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.045536:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.045608:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788271776.045614:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271776.045640:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.045681:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 53 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.045698:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 52 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.045706:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:2.0:1788271776.045710:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271776.045713:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ae00, rc 0) 00000100:00100000:2.0:1788271776.045740:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10568:x1875138574338432:12345-192.168.201.1@tcp:101:bash.0 Request processed in 3887us (4083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.045748:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:3.0:1788271776.053016:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.053142:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574338816 00000100:00100000:2.0:1788271776.053153:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574338816 00000100:00100000:2.0:1788271776.053221:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1788271776.053233:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:10568:x1875138574338816:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1788271776.053578:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10568:x1875138574338816:12345-192.168.201.1@tcp:35:bash.0 Request processed in 345us (634us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788271776.053587:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:1.0:1788271776.115637:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.115737:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574338944 00000100:00100000:3.0:1788271776.115753:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574338944 00000100:00100000:3.0:1788271776.115833:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:3.0:1788271776.115846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:10574:x1875138574338944:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271776.115882:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271776.115910:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239da expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.116012:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f799c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.116028:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f799c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.116040:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f799c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271776.116124:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788271776.116150:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271776.116184:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f799c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.116216:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239da expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.116240:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f799c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239da expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.116251:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271776.116254:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271776.116258:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19200, rc 0) 00000100:00100000:3.0:1788271776.116363:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10574:x1875138574338944:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 519us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.116371:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:3.0:1788271776.119914:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.122708:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574339072 00000100:00100000:0.0:1788271776.122726:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574339072 00000100:00100000:0.0:1788271776.122802:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 108 00000100:00100000:0.0:1788271776.122814:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10574:x1875138574339072:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271776.122841:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271776.122869:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f79a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.122943:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.122979:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.122994:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123011:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123017:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123021:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123132:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123138:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123143:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271776.123181:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788271776.123185:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788271776.123202:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123212:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123227:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123231:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123237:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123241:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271776.123245:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123249:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123260:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271776.123263:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271776.123266:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123269:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123279:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123282:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123286:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123293:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271776.123295:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123298:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123303:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c2fd1900) 00010000:00010000:0.0:1788271776.123304:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271776.123305:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123308:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123332:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f79a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239e1 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123358:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239e1 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.123366:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271776.123368:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271776.123370:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375600, rc 0) 00000100:00100000:0.0:1788271776.125810:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10574:x1875138574339072:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 2983us (5896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.125825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 108 00000100:00100000:1.0:1788271776.132571:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.133672:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.134369:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574339456 00000100:00100000:0.0:1788271776.134403:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574339456 00000100:00100000:0.0:1788271776.134528:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1788271776.134541:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:2354:x1875138574339456:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271776.134563:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271776.134598:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239e1 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.134623:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271776.134629:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271776.134726:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:2354:x1875138574339456:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 186us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.134734:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:2.0:1788271776.135828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574339328 00000100:00100000:2.0:1788271776.135839:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574339328 00000100:00100000:2.0:1788271776.135913:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:2.0:1788271776.135924:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10574:x1875138574339328:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271776.135957:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.135979:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239e8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.136104:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.136122:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 55 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.136132:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.136175:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 55 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.136204:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 55 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.136220:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eea7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586934528:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271776.136316:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1788271776.142346:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.142670:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eea7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586934528:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271776.142719:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.143244:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574339584 00000100:00100000:1.0:1788271776.143254:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574339584 00010000:00010000:1.0:1788271776.143302:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 56 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.143462:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:1.0:1788271776.143475:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:2353:x1875138574339584:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271776.143496:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271776.143505:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 56 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.143539:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 56 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.143568:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f798e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239d3 expref: 56 pid: 8302 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.143591:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:1.0:1788271776.143596:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.143607:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.143616:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.143699:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271776.143773:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:2353:x1875138574339584:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 299us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271776.143781:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00010000:00010000:2.0:1788271776.144815:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.144840:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.144864:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788271776.145257:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.145285:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.145296:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:2.0:1788271776.145300:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271776.145304:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a400, rc 0) 00000100:00100000:2.0:1788271776.148025:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10574:x1875138574339328:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 12087us (15454us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788271776.148041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:3.0:1788271776.158854:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.158982:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574339840 00000100:00100000:0.0:1788271776.158995:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574339840 00000100:00100000:0.0:1788271776.159080:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:0.0:1788271776.159094:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10574:x1875138574339840:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:0.0:1788271776.159115:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271776.159145:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239be expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.159169:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271776.159174:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271776.159252:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10574:x1875138574339840:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 161us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.159260:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:1.0:1788271776.166978:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.167104:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574339968 00000100:00100000:2.0:1788271776.167118:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574339968 00000100:00100000:2.0:1788271776.167207:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00100000:2.0:1788271776.167219:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10574:x1875138574339968:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:2.0:1788271776.167406:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.167473:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.167488:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271776.167756:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788271776.167867:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10574:x1875138574339968:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 648us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.167876:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00100000:3.0:1788271776.170743:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.171611:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574340096 00000100:00100000:0.0:1788271776.171626:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574340096 00000100:00100000:0.0:1788271776.171845:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 111 00000100:00100000:0.0:1788271776.171859:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:10574:x1875138574340096:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271776.171888:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271776.171919:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239ef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.172017:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.172031:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.172055:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.172071:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.172087:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271776.172091:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271776.172095:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.172104:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375600, rc 0) 00000100:00100000:0.0:1788271776.172322:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10574:x1875138574340096:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 465us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.172330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 111 00000001:00080000:1.0:1788271776.292240:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788271776.292263:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788271776.366456:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.366499:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.366558:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.366599:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.366739:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574340480 00000100:00100000:1.0:1788271776.366752:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574340480 00000100:00100000:1.0:1788271776.366819:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574340352 00000100:00100000:1.0:1788271776.366823:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574340352 00000100:00100000:1.0:1788271776.366853:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:1.0:1788271776.366864:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574340480:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271776.366972:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2354:x1875138574340480:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 108us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271776.366981:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:1.0:1788271776.367003:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:1.0:1788271776.367010:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574340352:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271776.367035:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574340352:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271776.367041:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:0.0:1788271776.367598:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574340224 00000100:00100000:0.0:1788271776.367611:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574340224 00000100:00100000:0.0:1788271776.367657:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 284 00000100:00100000:0.0:1788271776.367666:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574340224:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271776.367721:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574340224:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 56us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.367728:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 284 00000100:00100000:2.0:1788271776.368107:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574340608 00000100:00100000:2.0:1788271776.368112:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574340608 00000100:00100000:2.0:1788271776.368172:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:2.0:1788271776.368181:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574340608:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271776.368224:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2354:x1875138574340608:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 44us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.368231:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00080000:0.0:1788271776.368598:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788271776.627173:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271776.627186:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271776.627237:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788271776.627244:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271776.627490:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0aca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586934656:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788271776.627646:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271776.634473:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.635056:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574340736 00000100:00100000:0.0:1788271776.635071:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574340736 00000100:00100000:0.0:1788271776.635152:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:0.0:1788271776.635164:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574340736:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788271776.635212:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788271776.635382:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574340736:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 217us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.635391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:1.0:1788271776.636189:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0aca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586934656:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271776.641260:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.641508:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574340864 00000100:00100000:2.0:1788271776.641522:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574340864 00000100:00100000:2.0:1788271776.641601:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:2.0:1788271776.641614:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10576:x1875138574340864:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788271776.641725:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.641746:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.641760:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.641937:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.641980:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.641993:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642029:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642187:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642195:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.642288:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788271776.642293:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271776.642307:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642319:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642334:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642341:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642347:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271776.642351:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642366:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642380:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:2.0:1788271776.642383:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.642388:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642394:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f79e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642496:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642503:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642510:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642515:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271776.642518:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642742:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642751:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8ab6c4f64900) 00010000:00010000:2.0:1788271776.642754:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.642757:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642773:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f79e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642788:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642794:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642800:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642805:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271776.642808:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642814:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642822:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:2.0:1788271776.642825:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.642827:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.642833:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f79f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.642973:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10576:x1875138574340864:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 1357us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.642985:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:2.0:1788271776.647365:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.647620:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574341120 00000100:00100000:0.0:1788271776.647631:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574341120 00000100:00100000:0.0:1788271776.647790:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:0.0:1788271776.647801:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:10576:x1875138574341120:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271776.647823:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271776.647845:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239f6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.647951:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.647967:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.647998:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271776.648012:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788271776.648236:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648245:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648252:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648258:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271776.648262:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648269:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648283:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271776.648286:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788271776.648290:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648297:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f79fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648345:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79f7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239f6 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648369:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:0.0:1788271776.648372:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271776.648376:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f79f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239f6 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.648386:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375c00, rc 0) 00000100:00100000:0.0:1788271776.648602:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574341120:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 802us (1248us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788271776.648610:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:0.0:1788271776.653044:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.653574:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574341248 00000100:00100000:1.0:1788271776.653584:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574341248 00000100:00100000:1.0:1788271776.653693:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:1.0:1788271776.653704:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574341248:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788271776.653742:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788271776.653848:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574341248:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 146us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271776.653856:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:1.0:1788271776.657916:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.658013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574341504 00000100:00100000:3.0:1788271776.658025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574341504 00000100:00100000:3.0:1788271776.658083:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:3.0:1788271776.658095:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574341504:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271776.658115:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271776.658118:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788271776.658145:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f799c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239da expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.658165:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271776.658171:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271776.658183:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a0c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7693264610239fd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271776.658847:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788271776.659034:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.659047:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.659058:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.659111:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a0c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239fd expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.659127:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239fd expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.659135:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c3e3c100) 00010000:00010000:3.0:1788271776.659138:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271776.659148:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18000, rc 0) 00000100:00100000:3.0:1788271776.659226:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10576:x1875138574341504:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1129us (1316us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788271776.659235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:3.0:1788271776.665373:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.665498:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574341760 00000100:00100000:2.0:1788271776.665508:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574341760 00000100:00100000:2.0:1788271776.665577:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:2.0:1788271776.665589:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10576:x1875138574341760:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788271776.665645:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271776.665672:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239fd expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.665910:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c3e3c100) 00010000:00010000:2.0:1788271776.665921:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271776.665943:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.665958:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.665969:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666030:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666039:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666046:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666124:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666147:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666154:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666160:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271776.666165:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666172:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666181:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:2.0:1788271776.666184:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.666188:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666193:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7a21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666335:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666344:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666350:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666356:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271776.666367:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666373:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666381:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x73ad861 (ffff8ab6c4f64900) 00010000:00010000:2.0:1788271776.666384:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.666387:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.666393:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7a28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x73ad861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.666567:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574341760:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 979us (1203us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271776.666576:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:2.0:1788271776.668829:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.668915:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574341888 00000100:00100000:0.0:1788271776.668925:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574341888 00000100:00100000:0.0:1788271776.668981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:0.0:1788271776.668991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:10576:x1875138574341888:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271776.669012:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271776.669032:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7a2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a04 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.669060:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.669079:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.669088:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.669189:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f7a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.669202:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.669220:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:0.0:1788271776.669222:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271776.669224:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375e00, rc 0) 00000100:00100000:0.0:1788271776.669267:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10576:x1875138574341888:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 279us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.669273:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:1.0:1788271776.672749:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.672962:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574342144 00000100:00100000:3.0:1788271776.672971:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574342144 00000100:00100000:3.0:1788271776.673071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:3.0:1788271776.673082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:10576:x1875138574342144:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271776.673170:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.673188:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.673199:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271776.673494:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1788271776.673503:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339855089651ns, next at 340855087564ns, rc = 0 00000004:00010000:3.0:1788271776.673708:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000089f4dec reply state 00000000ae5cc34c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.673718:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271776.673842:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:10576:x1875138574342144:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 762us (1102us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788271776.673850:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 119 00010000:00010000:1.0:1788271776.676708:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.676727:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.676735:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.676742:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271776.676746:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.676753:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.676771:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:1.0:1788271776.676774:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788271776.676779:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.676785:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7a3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.677405:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.677929:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574342272 00000100:00100000:3.0:1788271776.677946:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574342272 00000100:00100000:3.0:1788271776.678053:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:3.0:1788271776.678064:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:10576:x1875138574342272:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271776.678098:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271776.678125:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a0b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.678206:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.678225:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.678251:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:3.0:1788271776.678254:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271776.678258:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19200, rc 0) 00000100:00100000:3.0:1788271776.678602:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:10576:x1875138574342272:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 537us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.678611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:3.0:1788271776.684367:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.684655:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574342400 00000100:00100000:1.0:1788271776.684670:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574342400 00000100:00100000:1.0:1788271776.684740:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1788271776.684750:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574342400:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788271776.685051:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2353:x1875138574342400:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 301us (698us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788271776.685075:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:0.0:1788271776.688233:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.691078:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574342656 00000100:00100000:2.0:1788271776.691091:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574342656 00000100:00100000:2.0:1788271776.692298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:2.0:1788271776.692314:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:10576:x1875138574342656:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788271776.692591:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:10576:x1875138574342656:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 280us (4367us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788271776.692599:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:3.0:1788271776.696057:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.696138:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574342912 00000100:00100000:2.0:1788271776.696153:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574342912 00000100:00100000:2.0:1788271776.696232:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:2.0:1788271776.696243:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:10576:x1875138574342912:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271776.696376:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:10576:x1875138574342912:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 134us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.696385:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:3.0:1788271776.698473:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.698692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574343040 00000100:00100000:0.0:1788271776.698701:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574343040 00000100:00100000:0.0:1788271776.698751:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:0.0:1788271776.698762:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:10576:x1875138574343040:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271776.698778:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271776.698797:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a12 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.698859:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.698873:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.698900:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271776.698935:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788271776.698953:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.698977:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a12 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.698994:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a12 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.699002:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:0.0:1788271776.699005:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788271776.699008:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374600, rc 0) 00000100:00100000:0.0:1788271776.699064:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:10576:x1875138574343040:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 303us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.699071:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:0.0:1788271776.704860:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.705052:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574343168 00000100:00100000:3.0:1788271776.705065:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574343168 00000100:00100000:3.0:1788271776.705134:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:3.0:1788271776.705149:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2353:x1875138574343168:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271776.705172:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271776.705200:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a19 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271776.705253:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dca0, blocks: 0x1 00010000:00010000:3.0:1788271776.705278:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1788271776.705283:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271776.705306:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 10 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.705400:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 10 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.705449:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18e00, rc 0) 00000100:00100000:3.0:1788271776.705525:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:2353:x1875138574343168:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 381us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.705534:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:1.0:1788271776.718139:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.718237:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574343424 00000100:00100000:2.0:1788271776.718248:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574343424 00000100:00100000:2.0:1788271776.718311:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:2.0:1788271776.718322:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:10576:x1875138574343424:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271776.718499:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:10576:x1875138574343424:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 178us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.718515:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:3.0:1788271776.724714:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.724811:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574343552 00000100:00100000:1.0:1788271776.724825:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574343552 00000100:00100000:1.0:1788271776.724908:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1788271776.724920:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:10576:x1875138574343552:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271776.724939:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271776.724960:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a20 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.724995:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 11 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.725005:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271776.725009:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271776.725015:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.725053:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 11 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.725069:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 11 pid: 8463 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.725083:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875138586934784:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271776.725390:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271776.731858:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.732216:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574343680 00000100:00100000:3.0:1788271776.732230:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574343680 00010000:00010000:3.0:1788271776.732285:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 12 pid: 8463 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.732497:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875138586934784:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271776.732514:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:3.0:1788271776.732529:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:2354:x1875138574343680:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271776.732546:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.732552:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271776.732573:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7e00, rc 0) 00010000:00010000:3.0:1788271776.732591:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 12 pid: 8463 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.732647:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:10576:x1875138574343552:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 7725us (7946us total) trans 0 rc 0/0 00010000:00010000:3.0:1788271776.732651:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 12 pid: 8463 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.732669:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00010000:00010000:3.0:1788271776.732704:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f7a59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a19 expref: 12 pid: 8463 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.732727:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271776.732732:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271776.732875:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.732889:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.732939:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.732956:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c5763800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875138586934912:192.168.201.1@tcp:105: 00000100:00100000:3.0:1788271776.733058:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9ff3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271776.739143:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c5763800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875138586934912:192.168.201.1@tcp:105: 00010000:00010000:3.0:1788271776.739180:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271776.739254:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:2354:x1875138574343680:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 6727us (7410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.739265:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:0.0:1788271776.742652:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.742877:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574343808 00000100:00100000:1.0:1788271776.742891:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574343808 00002000:00100000:1.0:1788271776.742957:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ab6ff9c2a00 x1875138574343808/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:682/0 lens 504/0 e 0 to 0 dl 1788271787 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271776.742970:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ff9c2a00 with x1875138574343808 ext(0->12) 00002000:00010000:1.0:1788271776.742978:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6ff9c2a00 00000100:00100000:1.0:1788271776.743075:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:1.0:1788271776.743087:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:2354:x1875138574343808:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788271776.743777:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:2354:x1875138574343808:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 687us (1520us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788271776.743788:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00002000:00100000:1.0:1788271776.743796:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ab6ff9c2a00 x1875138574343808/t4294967308(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:682/0 lens 504/448 e 0 to 0 dl 1788271787 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271776.743806:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ff9c2a00 with x1875138574343808 ext(0->12) 00002000:00010000:1.0:1788271776.743811:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6ff9c2a00 00000100:00100000:0.0:1788271776.750534:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.750784:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574343936 00000100:00100000:2.0:1788271776.750798:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574343936 00000100:00100000:2.0:1788271776.750878:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:2.0:1788271776.750891:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:10576:x1875138574343936:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1788271776.765467:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788271776.799258:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:1.0:1788271776.799303:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab6c9292900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788271776.799309:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6f7397700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6c9292480 00000020:00080000:1.0:1788271776.799313:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6f7397600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6c12abc00 00000020:00080000:1.0:1788271776.799347:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab6ff3706c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788271776.799351:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6c9fd2e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6ff3703c0 00000020:00080000:1.0:1788271776.799354:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6c9fd2100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6f7368400 00000001:00080000:1.0:1788271776.799391:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788271776.799437:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788271776.799467:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788271776.799487:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788271776.799494:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788271776.799856:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788271776.800080:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788271776.800106:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586935040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788271776.800198:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271776.800286:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271776.800302:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586935168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788271776.800337:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271776.800482:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586935040 00000100:00100000:1.0:1788271776.800492:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586935040 00000100:00100000:1.0:1788271776.800570:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586935168 00000100:00100000:1.0:1788271776.800574:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586935168 00000100:00100000:1.0:1788271776.800598:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788271776.800609:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586935040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788271776.800650:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788271776.800694:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.800721:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.800730:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788271776.800755:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271776.800761:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.800797:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.800813:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 11 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.800826:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1875138586935296:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271776.800907:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff2649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271776.800927:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788271776.800935:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586935168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788271776.801115:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788271776.801119:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788271776 00002000:00010000:1.0:1788271776.801122:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788271776.801125:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788271776 -> 1788271776 00002000:00010000:1.0:1788271776.801128:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788271776.801179:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3278:x1875138586935168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (840us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788271776.801187:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788271776.802093:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788271776.802159:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6cc0ac380/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788271776.802171:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586935168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788271776.802579:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:10576:x1875138574343936:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 51686us (52056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.802590:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:3.0:1788271776.802827:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271776.802843:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c5763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586935424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788271776.804097:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271776.804389:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586935424 00000100:00100000:1.0:1788271776.804401:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586935424 00000100:00100000:1.0:1788271776.804594:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788271776.804606:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586935424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788271776.804679:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788271776.804726:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a96dc9e, atime: 0x6a96dc9f, ctime: 0x6a96dc9e, blocks: 0xb 00010000:00010000:1.0:1788271776.804736:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.804758:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1788271776.804763:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271776.804772:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.804794:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.804807:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.804816:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.804844:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271776.805482:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271776.805493:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.805504:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271776.805509:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.805520:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.805545:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.805554:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004772c680/0xbeb05ca97b5f7a6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.805577:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271776.805579:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271776.805581:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271776.806138:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875138586935424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1531us (2042us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788271776.806152:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788271776.807070:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788271776.807101:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1788271776.807133:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6edf4d180, transno 4294967301 00000004:00080000:3.0:1788271776.807274:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1788271776.807305:0:3281:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab6c5763800 x1875138586935424/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788271792 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788271776.807320:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6c5763800/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788271776.807655:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c5763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586935424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788271776.810830:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.810873:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271776.810920:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574344192 00000100:00100000:0.0:1788271776.810933:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574344192 00010000:00010000:0.0:1788271776.810982:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 12 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271776.811046:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:0.0:1788271776.811059:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:2353:x1875138574344192:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271776.811080:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271776.811087:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 12 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.811104:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 12 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.811138:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271776.811144:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271776.811151:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.811163:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.811189:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271776.811256:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:2353:x1875138574344192:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 199us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.811264:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00010000:00010000:1.0:1788271776.811646:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7829 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.1@tcp remote: 0x76932646102397f expref: 11 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.811673:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1875138586935296:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271776.811708:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.811720:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.811728:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.811741:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.811750:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.811770:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788271776.812541:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3278:x1875138586935040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11928us (12338us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788271776.812553:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788271776.812579:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574344064 00000100:00100000:1.0:1788271776.812585:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574344064 00000100:00100000:1.0:1788271776.812623:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:1.0:1788271776.812632:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:2354:x1875138574344064:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788271776.812707:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271776.812717:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.812743:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271776.812749:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.812762:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.812780:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.812789:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db0c3e94/0xbeb05ca97b5f7a67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.812811:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271776.812813:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271776.812815:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788271776.815410:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6cc0adc00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788271776.815467:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586935040:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788271776.894800:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788271776.894837:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788271776.894855:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788271776.895399:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574344064:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 82757us (84572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271776.895449:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:0.0:1788271776.899223:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.899348:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574344448 00000100:00100000:2.0:1788271776.899364:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574344448 00000100:00100000:2.0:1788271776.899465:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:2.0:1788271776.899477:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:10576:x1875138574344448:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788271776.899555:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271776.899593:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a12 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.899617:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:2.0:1788271776.899623:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271776.899665:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.899694:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.899706:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271776.900016:0:8302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005767d0d3 reply state 0000000056b532bb transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.900027:0:8302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271776.900154:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:10576:x1875138574344448:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 677us (944us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788271776.900183:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 125 00010000:00010000:0.0:1788271776.907266:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.907311:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.907319:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.907336:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ae00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271776.907343:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.907354:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.907377:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:0.0:1788271776.907381:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271776.907386:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.907393:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7a75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.908553:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.908693:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574344576 00000100:00100000:1.0:1788271776.908708:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574344576 00000100:00100000:1.0:1788271776.908790:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:1.0:1788271776.908803:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574344576:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788271776.909140:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788271776.909144:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788271776 -> 1788271775 00002000:00010000:1.0:1788271776.909162:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788271775 00002000:00010000:1.0:1788271776.909165:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788271776 -> 1788271775 00002000:00010000:1.0:1788271776.909168:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788271776.909257:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2352:x1875138574344576:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 456us (714us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788271776.909267:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1788271776.914167:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.914268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574344832 00000100:00100000:3.0:1788271776.914287:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574344832 00000100:00100000:3.0:1788271776.914383:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:3.0:1788271776.914396:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:10576:x1875138574344832:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788271776.914530:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.914552:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.914562:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.914608:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.914624:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 15 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.914641:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c5761180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586935552:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271776.916004:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c12ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271776.921664:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.921992:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574344960 00000100:00100000:2.0:1788271776.922004:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574344960 00010000:00010000:2.0:1788271776.922064:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 16 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.922119:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1788271776.922136:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:2353:x1875138574344960:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271776.922158:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271776.922165:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 16 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.922182:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 16 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.922216:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:2.0:1788271776.922222:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.922235:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.922244:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.922266:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271776.922354:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:2353:x1875138574344960:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 222us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.922388:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00010000:00010000:3.0:1788271776.922565:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a04 expref: 15 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.922585:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c5761180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586935552:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271776.922608:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922618:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922625:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922663:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922671:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922679:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922686:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271776.922691:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922700:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922712:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:3.0:1788271776.922715:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788271776.922733:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.922741:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7a7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.922809:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:10576:x1875138574344832:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 8416us (8658us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788271776.922818:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:0.0:1788271776.925096:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.925218:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574345088 00000100:00100000:1.0:1788271776.925230:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574345088 00000100:00100000:1.0:1788271776.925297:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:1.0:1788271776.925310:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fee61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574345088:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788271776.925386:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.925410:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.925457:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788271776.925462:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271776.925467:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.925518:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.925535:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 7 pid: 6698 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.925578:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875138586935680:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271776.925692:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff2649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271776.927529:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875138586935680:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271776.927566:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271776.927972:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.928199:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574345216 00000100:00100000:2.0:1788271776.928208:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574345216 00010000:00010000:2.0:1788271776.928256:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 8 pid: 6698 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.928300:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:2.0:1788271776.928312:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574345216:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271776.928338:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271776.928371:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 8 pid: 6698 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.928386:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 8 pid: 6698 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.928446:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7a60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a20 expref: 8 pid: 6698 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.928466:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271776.928471:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271776.928477:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.928497:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.928527:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271776.928590:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574345216:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 279us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.928598:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00010000:00010000:3.0:1788271776.928686:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928697:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928727:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928736:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928746:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928753:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271776.928758:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928780:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928794:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.928802:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ec22ab/0xbeb05ca97b5f7a83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.928855:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fee61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574345088:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 3548us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.928863:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:1.0:1788271776.931696:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.931828:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574345472 00000100:00100000:2.0:1788271776.931841:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574345472 00000100:00100000:2.0:1788271776.931915:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 127 00000100:00100000:2.0:1788271776.931928:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:10576:x1875138574345472:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788271776.932038:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.932060:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.932074:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.932368:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.932381:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.932390:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.932485:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.932502:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 15 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.932520:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586935808:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271776.932639:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271776.940540:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271776.940716:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586935808:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271776.940753:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.940850:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574345600 00000100:00100000:3.0:1788271776.940860:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574345600 00010000:00010000:3.0:1788271776.944456:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 16 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271776.944532:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:3.0:1788271776.944558:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:2353:x1875138574345600:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271776.944580:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271776.944588:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 16 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.944604:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 16 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.944653:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7a44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a0b expref: 16 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.944671:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:3.0:1788271776.944676:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.944685:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.944694:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.944735:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271776.944821:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:2353:x1875138574345600:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 278us (4295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.944829:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00010000:00010000:1.0:1788271776.945117:0:8302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.945127:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271776.945452:0:8302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788271776.945616:0:8302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788271776.945656:0:8302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788271776.945748:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8302:1875138586935936:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788271776.945823:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271776.945858:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff2649c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271776.945942:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586935936 00000100:00100000:3.0:1788271776.945949:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586935936 00000100:00100000:3.0:1788271776.945993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271776.945999:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8302:x1875138586935936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788271776.946081:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8302:x1875138586935936:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.946089:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271776.946236:0:8302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788271776.946243:0:8302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1788271776.946265:0:8302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6cc0ac380, transno 4294967309 00000004:00080000:1.0:1788271776.946284:0:8302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6cc0adc00, transno 4294967310 00000100:00100000:1.0:1788271776.946293:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8302:1875138586935936:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788271776.946865:0:8302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788271776.946934:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cc0ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8302:1875138586936064:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788271776.946983:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271776.947011:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9ff3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271776.947573:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586936064 00000100:00100000:3.0:1788271776.947581:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586936064 00000100:00100000:3.0:1788271776.947642:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271776.947652:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8302:x1875138586936064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788271776.947873:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8302:x1875138586936064:12345-0@lo:1000:mdt00_003.0 Request processed in 222us (888us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788271776.947883:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271776.948049:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cc0ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8302:1875138586936064:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788271776.948092:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948104:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948113:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948120:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271776.948126:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948135:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948155:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:1.0:1788271776.948158:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271776.948163:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948170:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7a91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948207:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948214:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948228:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948233:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271776.948236:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948243:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948252:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:1.0:1788271776.948255:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271776.948263:0:8302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948276:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948286:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.948318:0:8302:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.948346:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586936192:192.168.201.1@tcp:105: 00000100:00100000:1.0:1788271776.948504:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9ff3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271776.956007:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.956099:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574345728 00000100:00100000:2.0:1788271776.956114:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574345728 00000100:00100000:2.0:1788271776.956196:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:2.0:1788271776.956209:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:10574:x1875138574345728:12345-192.168.201.1@tcp:49:lfs.0 00000100:00100000:2.0:1788271776.956445:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:10574:x1875138574345728:12345-192.168.201.1@tcp:49:lfs.0 Request processed in 238us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.956454:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:1.0:1788271776.956984:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586936192:192.168.201.1@tcp:105: 00010000:00010000:1.0:1788271776.957036:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957049:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f79d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957094:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957110:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957125:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957137:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957143:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957150:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957157:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271776.957161:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957169:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957183:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:1.0:1788271776.957187:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271776.957197:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957204:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7a98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957216:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957223:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957229:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957235:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271776.957238:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957244:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957252:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:1.0:1788271776.957255:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788271776.957258:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.957264:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7a8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271776.957663:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:10576:x1875138574345472:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 25734us (25979us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788271776.958261:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 127 00000020:00080000:1.0:1788271776.958280:0:8302:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788271776.958968:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271776.958977:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271776.959516:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788271776.959528:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788271776.964957:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271776.968133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574345984 00000100:00100000:3.0:1788271776.968153:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574345984 00000100:00100000:3.0:1788271776.968234:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 128 00000100:00100000:3.0:1788271776.968245:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:10574:x1875138574345984:12345-192.168.201.1@tcp:58:lfs.0 00000040:00080000:3.0:1788271776.968788:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788271776.973863:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:10574:x1875138574345984:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 5601us (8903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.973883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 128 00000100:00100000:1.0:1788271776.976649:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271776.976797:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574346240 00000100:00100000:2.0:1788271776.976810:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574346240 00000100:00100000:2.0:1788271776.976891:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:2.0:1788271776.976903:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:10576:x1875138574346240:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788271776.977800:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788271776.977937:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788271776.978004:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978039:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978051:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978058:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978065:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978097:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788271776.978790:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:10576:x1875138574346240:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 1882us (2148us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788271776.978801:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000020:00080000:2.0:1788271776.978808:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271776.978879:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271776.978886:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978894:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271776.978899:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978908:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978934:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab6c4f64900) 00010000:00010000:2.0:1788271776.978937:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788271776.978943:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978950:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7a9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.978971:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271776.978973:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271776.978975:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271777.013948:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271777.014058:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574346368 00000100:00100000:3.0:1788271777.014070:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574346368 00000100:00100000:3.0:1788271777.014150:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 129 00000100:00100000:3.0:1788271777.014162:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:10578:x1875138574346368:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271777.014197:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271777.014226:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a27 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.014311:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.014338:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.014351:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.014395:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.014404:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.014606:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.019649:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.020931:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.020948:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.021014:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.021033:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 21 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271777.021053:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586936320:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271777.021292:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271777.032683:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271777.032831:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574346624 00000100:00100000:3.0:1788271777.032844:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574346624 00000100:00100000:3.0:1788271777.032934:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:3.0:1788271777.032946:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:5594:x1875138574346624:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788271777.033276:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:5594:x1875138574346624:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 332us (617us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788271777.033285:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1788271777.034444:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586936320:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271777.034504:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271777.038799:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271777.039007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574346752 00000100:00100000:2.0:1788271777.039022:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574346752 00010000:00010000:2.0:1788271777.039080:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 23 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271777.039133:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:2.0:1788271777.039147:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:2354:x1875138574346752:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271777.039166:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271777.039175:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 23 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.039192:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 23 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.039221:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f79c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x7693264610239e8 expref: 23 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.039247:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:2.0:1788271777.039253:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.039265:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.039274:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271777.039336:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271777.039473:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:2354:x1875138574346752:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 326us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271777.039481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00010000:00010000:3.0:1788271777.040211:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040224:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271777.040288:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788271777.040293:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271777.040329:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040347:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040377:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040385:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040394:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040401:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271777.040406:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040445:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040461:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:3.0:1788271777.040464:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271777.040468:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040474:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7aad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040491:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040498:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040504:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040517:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271777.040520:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040526:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040535:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab6c3e3cc00) 00010000:00010000:3.0:1788271777.040537:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271777.040540:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040546:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040591:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a27 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040608:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a27 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.040615:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:3.0:1788271777.040618:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271777.040621:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b000, rc 0) 00000100:00100000:3.0:1788271777.040685:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10578:x1875138574346368:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 26525us (26751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271777.040694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 129 00010000:00010000:1.0:1788271777.779096:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271777.852802:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271777.852822:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271777.853323:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788271777.853331:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788271777.971088:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271777.971097:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271777.971149:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788271777.971156:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788271777.971274:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586936448:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788271777.971403:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c551e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271777.976909:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271777.976943:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574346880 00000100:00100000:0.0:1788271777.976953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574346880 00000100:00100000:3.0:1788271777.977175:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586936448:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271777.977464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:0.0:1788271777.977475:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10590:x1875138574346880:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788271777.977510:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788271777.977613:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10590:x1875138574346880:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 140us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271777.977621:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:2.0:1788271777.985039:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271777.985086:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574347136 00000100:00100000:1.0:1788271777.985097:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574347136 00000100:00100000:1.0:1788271777.985158:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 131 00000100:00100000:1.0:1788271777.985169:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:10590:x1875138574347136:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271777.985189:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271777.985209:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7ac2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a2e expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271777.985323:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271777.985339:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271777.985353:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271777.985364:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788271777.985549:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7ac2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a2e expref: 24 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271777.985565:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a2e expref: 23 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271777.985573:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:1.0:1788271777.985576:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271777.985585:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6e00, rc 0) 00000100:00100000:1.0:1788271777.985667:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:10590:x1875138574347136:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 492us (630us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788271777.985675:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 131 00000100:00100000:3.0:1788271777.993105:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271777.993155:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271777.993190:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574347520 00000100:00100000:3.0:1788271777.993199:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574347520 00000100:00100000:3.0:1788271777.993248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 132 00000100:00100000:3.0:1788271777.993257:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:10590:x1875138574347520:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788271777.993360:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993378:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993389:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993587:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993595:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993602:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993609:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271777.993614:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993629:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993642:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:3.0:1788271777.993645:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271777.993650:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271777.993656:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ad7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271777.993800:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:10590:x1875138574347520:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 542us (642us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788271777.993808:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 132 00000040:00080000:3.0:1788271777.993996:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271777.994000:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271777.994508:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788271777.994517:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271777.994633:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574347264 00000100:00100000:1.0:1788271777.994640:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574347264 00000100:00100000:1.0:1788271777.994691:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271777.994700:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:2353:x1875138574347264:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271777.994714:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271777.994732:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a2e expref: 24 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271777.994745:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:1.0:1788271777.994748:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271777.994776:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:2353:x1875138574347264:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 77us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271777.994784:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1788271778.004281:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271778.004407:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574347776 00000100:00100000:3.0:1788271778.004939:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574347776 00000100:00100000:3.0:1788271778.005938:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:3.0:1788271778.005954:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:10590:x1875138574347776:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271778.006192:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:10590:x1875138574347776:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 242us (1921us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788271778.006199:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00080000:2.0:1788271778.006785:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271778.803037:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271778.805063:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586936960:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805143:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271778.805211:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788271778.805218:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586936576:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805250:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271778.805271:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586937088:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805305:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271778.805332:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586936832:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805354:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271778.805370:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788271778.805375:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586936704:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805394:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271778.805409:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586937216:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805451:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271778.805477:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937088 00000100:00100000:0.0:1788271778.805484:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937088 00000100:00100000:0.0:1788271778.805534:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586936832 00000100:00100000:2.0:1788271778.805545:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271778.805553:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586936832 00000100:00100000:2.0:1788271778.805560:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586937344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271778.805573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586936704 00000100:00100000:0.0:1788271778.805577:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586936704 00000100:00100000:0.0:1788271778.805597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788271778.805601:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271778.805610:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586937088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.805641:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586936960 00000100:00100000:2.0:1788271778.805647:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586936960 00000100:00100000:2.0:1788271778.805682:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937216 00000100:00100000:0.0:1788271778.805682:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586937088:12345-0@lo:400:kworker.0 Request processed in 73us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.805687:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937216 00000100:00100000:0.0:1788271778.805694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788271778.805710:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271778.805718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788271778.805725:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586936832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.805734:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586936960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805756:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586936832:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.805763:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788271778.805780:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586936960:12345-0@lo:400:kworker.0 Request processed in 49us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.805780:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271778.805794:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271778.805796:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.805817:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271778.805828:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586936704:12345-0@lo:400:kworker.0 Request processed in 38us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.805834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271778.805847:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586937216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805869:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586936704:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805883:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586936832:0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.805891:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586937216:12345-0@lo:400:kworker.0 Request processed in 57us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.805909:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586937216:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805927:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586937088:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.805936:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586936960:0@lo:400:kworker.0 00000100:00080000:0.0:1788271778.805972:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271778.805980:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271778.805983:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271778.805996:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586936576 00000100:00100000:0.0:1788271778.806000:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586936576 00000100:00100000:0.0:1788271778.806025:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788271778.806032:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586936576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.806066:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586936576:12345-0@lo:400:kworker.0 Request processed in 34us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.806072:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788271778.806108:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586936576:0@lo:400:kworker.0 00000100:00100000:0.0:1788271778.806137:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937344 00000100:00100000:0.0:1788271778.806141:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937344 00000100:00100000:0.0:1788271778.806162:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788271778.806168:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586937344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271778.806175:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00002000:00000024:0.0:1788271778.806199:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271778.806247:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586937344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.806254:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788271778.806336:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586937472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271778.806372:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.806486:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586937344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271778.806783:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937472 00000100:00100000:0.0:1788271778.806788:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937472 00000100:00100000:0.0:1788271778.806822:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788271778.806829:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586937472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271778.806849:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271778.806890:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586937472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.806896:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271778.807236:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586937472:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788271779.718637:0:12156:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271779.718648:0:12156:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271779.718693:0:12156:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788271779.718699:0:12156:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788271779.827280:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271779.842232:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271779.844969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348032 00000100:00100000:2.0:1788271779.844983:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348032 00000100:00100000:3.0:1788271779.853004:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 133 00000100:00100000:3.0:1788271779.853021:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:10610:x1875138574348032:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271779.853062:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271779.853084:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ade lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a35 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271779.853180:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ae5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271779.853203:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ae5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271779.853214:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ae5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271779.853230:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788271779.853386:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18400/0xbeb05ca97b5f7ade lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a35 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271779.853405:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a35 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271779.853441:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:3.0:1788271779.853445:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788271779.853456:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19200, rc 0) 00000100:00100000:3.0:1788271779.853523:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:10610:x1875138574348032:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 508us (11299us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788271779.853531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 133 00000100:00100000:2.0:1788271779.861359:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271779.861468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348160 00000100:00100000:0.0:1788271779.861486:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348160 00000100:00100000:0.0:1788271779.861583:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:0.0:1788271779.861597:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:10610:x1875138574348160:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:0.0:1788271779.861709:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.861732:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.861747:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.861780:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.861788:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.861796:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.861803:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271779.861809:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.862797:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.862898:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271779.862903:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271779.862910:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271779.862933:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7af3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271779.863061:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:10610:x1875138574348160:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 1462us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271779.863082:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:2.0:1788271779.932367:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271779.932500:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348288 00000100:00100000:3.0:1788271779.932515:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348288 00000100:00100000:3.0:1788271779.932603:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:3.0:1788271779.932629:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574348288:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:3.0:1788271779.932656:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271779.932684:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3238f43/0xbeb05ca97b5f7afa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a3c expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271779.932719:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a96dc9f, atime: 0x6a96dc9f, ctime: 0x6a96dc9f, blocks: 0xb 00010000:00010000:3.0:1788271779.932741:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1788271779.932747:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271779.932758:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3238f43/0xbeb05ca97b5f7afa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a3c expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271779.932792:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3238f43/0xbeb05ca97b5f7afa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a3c expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271779.932806:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18400, rc 0) 00000100:00100000:3.0:1788271779.932892:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2352:x1875138574348288:12345-192.168.201.1@tcp:101:cat.0 Request processed in 267us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271779.932900:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00080000:2.0:1788271779.932981:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271779.936342:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271779.936402:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348416 00000100:00100000:3.0:1788271779.936441:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348416 00002000:00100000:3.0:1788271779.936513:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8ab6ee24dc00 x1875138574348416/t0(0) o3->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:685/0 lens 488/0 e 0 to 0 dl 1788271790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271779.936523:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ee24dc00 with x1875138574348416 ext(0->4095) 00002000:00010000:3.0:1788271779.936528:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6ee24dc00 00000100:00100000:3.0:1788271779.936566:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1788271779.936653:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574348416:12345-192.168.201.1@tcp:3:cat.0 00000100:00100000:3.0:1788271779.936930:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574348416:12345-192.168.201.1@tcp:3:cat.0 Request processed in 279us (596us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788271779.936939:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00002000:00100000:3.0:1788271779.936947:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8ab6ee24dc00 x1875138574348416/t0(0) o3->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:685/0 lens 488/4536 e 0 to 0 dl 1788271790 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271779.936954:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ee24dc00 with x1875138574348416 ext(0->4095) 00002000:00010000:3.0:1788271779.936957:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6ee24dc00 00010000:00010000:0.0:1788271780.863074:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788271781.410046:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:2.0:1788271781.488116:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271781.488168:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271781.488219:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271781.488298:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574349056 00000100:00100000:2.0:1788271781.488300:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271781.488313:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574349056 00000100:00100000:2.0:1788271781.488334:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271781.488442:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348800 00000100:00100000:3.0:1788271781.488447:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348800 00000100:00100000:3.0:1788271781.488486:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348928 00000100:00100000:3.0:1788271781.488489:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348928 00000100:00100000:3.0:1788271781.488518:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:3.0:1788271781.488532:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574348800:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271781.488540:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348544 00000100:00100000:1.0:1788271781.488546:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348544 00000100:00100000:3.0:1788271781.488632:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574348800:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 103us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.488639:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:0.0:1788271781.488666:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574348672 00000100:00100000:0.0:1788271781.488671:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574348672 00000100:00100000:3.0:1788271781.488684:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:3.0:1788271781.488695:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574348928:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271781.488707:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:0.0:1788271781.488719:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574349056:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271781.488728:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574348928:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 34us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.488736:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:0.0:1788271781.488760:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574349056:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 43us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.488765:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:0.0:1788271781.488775:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:3.0:1788271781.488780:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:2353:x1875138574348672:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271781.488812:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:2353:x1875138574348672:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 38us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.488851:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:1.0:1788271781.488857:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 286 00000100:00100000:1.0:1788271781.488870:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574348544:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271781.488903:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574348544:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 38us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271781.488920:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 286 00000100:00080000:0.0:1788271781.489951:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271781.489958:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271781.489962:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271781.874835:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788271781.950993:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788271781.951019:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788271781.955495:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:2.0:1788271781.955528:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab6ff264600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788271781.955534:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6caa24e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6eea44480 00000020:00080000:2.0:1788271781.955546:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6caa24b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6c9f65400 00000020:00080000:3.0:1788271781.955588:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1788271781.955873:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788271781.956168:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1788271781.956178:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00010000:00010000:0.0:1788271782.899289:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271783.922909:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586937600:0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923011:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271783.923078:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586938112:0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923109:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271783.923140:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271783.923147:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586937984:0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923175:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271783.923218:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586937728:0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923243:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271783.923275:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586938240:0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923298:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271783.923316:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271783.923321:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586937856:0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923342:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271783.923376:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937600 00000100:00100000:2.0:1788271783.923386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937600 00000100:00100000:2.0:1788271783.923495:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788271783.923506:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586937600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923687:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586937600:12345-0@lo:400:kworker.0 Request processed in 182us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271783.923696:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788271783.923737:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586938112 00000100:00100000:2.0:1788271783.923752:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586938112 00000100:00100000:2.0:1788271783.923794:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937728 00000100:00100000:2.0:1788271783.923798:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937728 00000100:00100000:2.0:1788271783.923882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937856 00000100:00100000:2.0:1788271783.923886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937856 00000100:00100000:2.0:1788271783.923906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788271783.923913:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586938112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.923947:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586938112:12345-0@lo:400:kworker.0 Request processed in 35us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271783.923953:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788271783.923966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788271783.923972:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586937728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.924005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586937728:12345-0@lo:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271783.924010:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788271783.924022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788271783.924028:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586937856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.924053:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586937856:12345-0@lo:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271783.924058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788271783.924079:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586937984 00000100:00100000:2.0:1788271783.924083:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586937984 00010000:00010000:1.0:1788271783.926626:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271783.927062:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586938240 00000100:00100000:2.0:1788271783.927076:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586938240 00000100:00100000:2.0:1788271783.927152:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271783.927165:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586937984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.927345:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586937984:12345-0@lo:400:kworker.0 Request processed in 182us (4168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271783.927367:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271783.927388:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271783.927394:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f780c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586938240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271783.927446:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f780c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586938240:12345-0@lo:400:kworker.0 Request processed in 52us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271783.927452:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788271783.928380:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271783.928387:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271783.928391:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271783.928658:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586938368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271783.928719:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271783.928934:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586938496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271783.928967:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.931539:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586937856:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.931577:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586937728:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.931589:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788271783.931596:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6c5763800, transno 4294967304 00000100:00100000:0.0:1788271783.931622:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586938240:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.931674:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788271783.931681:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788271783.931706:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586937984:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.931720:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586937600:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.931734:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586938112:0@lo:400:kworker.0 00000100:00100000:1.0:1788271783.937438:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586938368 00000100:00100000:1.0:1788271783.937459:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586938368 00000100:00100000:0.0:1788271783.937558:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586938496 00000100:00100000:0.0:1788271783.937563:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586938496 00000100:00100000:0.0:1788271783.937607:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788271783.937618:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586938368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271783.937670:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271783.937758:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586938368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (9039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.937766:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788271783.937786:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788271783.937793:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586938496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271783.938000:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271783.938035:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586938496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 243us (9067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.938041:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788271783.938097:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586938368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271783.938447:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586938496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271784.137879:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271784.138189:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574349184 00000100:00100000:2.0:1788271784.138213:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574349184 00000100:00100000:2.0:1788271784.138326:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:2.0:1788271784.138342:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10255:x1875138574349184:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788271784.138516:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10255:x1875138574349184:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 Request processed in 178us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271784.138525:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00080000:0.0:1788271784.138664:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271784.141060:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271784.141312:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574349440 00000100:00100000:1.0:1788271784.141325:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574349440 00000100:00100000:1.0:1788271784.141896:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:1.0:1788271784.141913:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:10255:x1875138574349440:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788271784.143260:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:10255:x1875138574349440:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 1333us (2207us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788271784.143274:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:1.0:1788271784.361526:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271784.361694:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574349568 00000100:00100000:2.0:1788271784.361704:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574349568 00000100:00100000:2.0:1788271784.361788:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 136 00000100:00100000:2.0:1788271784.361799:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:11062:x1875138574349568:12345-192.168.201.1@tcp:101:lsof.0 00010000:00010000:2.0:1788271784.361819:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271784.361840:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7b01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a43 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271784.361931:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271784.361946:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271784.361957:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271784.362149:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788271784.362153:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271784.362272:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271784.362301:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7b01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271784.362320:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271784.362329:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:2.0:1788271784.362333:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271784.362337:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a400, rc 0) 00000100:00080000:0.0:1788271784.362490:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271784.362744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:11062:x1875138574349568:12345-192.168.201.1@tcp:101:lsof.0 Request processed in 944us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271784.362751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 136 00010000:00010000:0.0:1788271784.946704:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271785.970656:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271786.162796:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271786.162808:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271786.163063:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788271786.163070:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788271786.609085:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271786.609129:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271786.609166:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271786.609186:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271786.609208:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271786.609238:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574349952 00000100:00100000:0.0:1788271786.609247:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574349952 00000100:00100000:0.0:1788271786.609300:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574350080 00000100:00100000:0.0:1788271786.609303:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574350080 00000100:00100000:0.0:1788271786.609324:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:0.0:1788271786.609334:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2351:x1875138574349952:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.609402:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2351:x1875138574349952:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.609409:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:0.0:1788271786.609454:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:0.0:1788271786.609462:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574350080:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.609488:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574350080:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.609495:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:0.0:1788271786.609517:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574350208 00000100:00100000:0.0:1788271786.609521:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574350208 00000100:00100000:0.0:1788271786.609545:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574349824 00000100:00100000:0.0:1788271786.609549:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574349824 00000100:00100000:0.0:1788271786.609573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:0.0:1788271786.609593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2351:x1875138574350208:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.609633:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2351:x1875138574350208:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.609640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:0.0:1788271786.609654:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 140 00000100:00100000:0.0:1788271786.609659:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2351:x1875138574349824:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.609686:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2351:x1875138574349824:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.609693:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 140 00000100:00080000:0.0:1788271786.609715:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271786.609720:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271786.609722:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271786.615463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574349696 00000100:00100000:3.0:1788271786.615477:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574349696 00000100:00100000:3.0:1788271786.615588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 288 00000100:00100000:3.0:1788271786.615600:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574349696:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271786.615690:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2351:x1875138574349696:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 92us (6614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271786.615698:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 288 00010000:00010000:0.0:1788271786.996023:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788271787.095121:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788271787.095289:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788271787.095318:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788271787.095334:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:3.0:1788271787.133273:0:12360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:09:45 (1788271785) 00010000:00010000:1.0:1788271788.018929:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271788.185222:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271788.185330:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574350464 00000100:00100000:1.0:1788271788.185339:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574350464 00000100:00100000:1.0:1788271788.185444:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 137 00000100:00100000:1.0:1788271788.185456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+13:11327:x1875138574350464:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271788.185477:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271788.185496:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7b0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a4a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.185567:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.185581:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.185606:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.185620:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.185627:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.185634:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186042:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7b24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186052:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7b24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186059:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7b24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271788.186069:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788271788.186273:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186281:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186288:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186294:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271788.186304:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186312:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186324:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab6c4f64400) 00010000:00010000:1.0:1788271788.186327:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271788.186332:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186338:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186350:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186356:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186362:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186367:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271788.186370:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186376:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186382:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab6cb419a00) 00010000:00010000:1.0:1788271788.186384:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271788.186393:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186398:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7b1d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186784:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7b0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a4a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186799:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7b24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a4a expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.186806:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:1.0:1788271788.186808:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271788.186811:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7800, rc 0) 00000100:00100000:1.0:1788271788.186866:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:11327:x1875138574350464:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1412us (1652us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788271788.186873:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 137 00000100:00080000:2.0:1788271788.187002:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271788.198253:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271788.198378:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574350592 00000100:00100000:0.0:1788271788.198393:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574350592 00000100:00100000:0.0:1788271788.198514:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 138 00000100:00100000:0.0:1788271788.198525:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:11327:x1875138574350592:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788271788.198648:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:11327:x1875138574350592:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 Request processed in 125us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271788.198656:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 138 00000100:00100000:0.0:1788271788.201591:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271788.201710:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574350720 00000100:00100000:1.0:1788271788.201720:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574350720 00000100:00100000:1.0:1788271788.201790:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1788271788.201801:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:2354:x1875138574350720:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271788.201815:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271788.201838:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7b24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a4a expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271788.201857:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:1.0:1788271788.201862:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271788.201933:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:2354:x1875138574350720:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 134us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271788.201941:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000040:00080000:2.0:1788271788.210639:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271788.210651:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271788.210689:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788271788.210696:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788271789.042838:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271789.044542:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c5760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586938624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271789.044655:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.044769:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586938624 00000100:00100000:3.0:1788271789.044779:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586938624 00000100:00100000:2.0:1788271789.045393:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586938752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271789.045476:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271789.045534:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586938752 00000100:00100000:2.0:1788271789.045541:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586938752 00000100:00100000:2.0:1788271789.045594:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788271789.045604:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586938752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271789.045646:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271789.045691:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586938752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271789.045699:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788271789.045722:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271789.045768:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586938752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271789.049724:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586938880:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.049773:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788271789.049789:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586938624:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271789.049868:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788271789.049920:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271789.049934:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271789.049944:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586939264:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.049989:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586938624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (5330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271789.049989:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.050143:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788271789.050174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586939264 00000100:00080000:3.0:1788271789.050184:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271789.050187:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586939264 00000100:00100000:3.0:1788271789.050207:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586939136:0@lo:400:kworker.0 00000100:00100000:1.0:1788271789.050268:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788271789.050283:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586939264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.050964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.051031:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c5760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586938624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271789.051128:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271789.051137:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586939008:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.051163:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271789.052196:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586939136 00000100:00100000:0.0:1788271789.052210:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586939136 00000100:00100000:0.0:1788271789.052257:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586939008 00000100:00100000:0.0:1788271789.052261:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586939008 00000100:00100000:0.0:1788271789.052286:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788271789.052296:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586939136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.052373:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586939136:12345-0@lo:400:kworker.0 Request processed in 78us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271789.052381:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788271789.052409:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788271789.052432:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586939008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.052599:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586939008:12345-0@lo:400:kworker.0 Request processed in 169us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271789.052606:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788271789.052646:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586939008:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.052658:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586939136:0@lo:400:kworker.0 00000100:00080000:3.0:1788271789.052931:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271789.056903:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586938880 00000100:00100000:2.0:1788271789.056918:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586938880 00000100:00100000:1.0:1788271789.056970:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586939264:12345-0@lo:400:kworker.0 Request processed in 6680us (6972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271789.056989:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788271789.056998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788271789.057012:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586938880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271789.057158:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3279:x1875138586938880:12345-0@lo:400:kworker.0 Request processed in 151us (7290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271789.057166:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788271789.057360:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586939264:0@lo:400:kworker.0 00000100:00100000:2.0:1788271789.057370:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586938880:0@lo:400:kworker.0 00000100:00100000:2.0:1788271790.017579:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271790.017619:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574350848 00000100:00100000:2.0:1788271790.017628:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574350848 00000100:00100000:2.0:1788271790.017689:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:2.0:1788271790.017700:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:11370:x1875138574350848:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271790.017719:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271790.017740:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a51 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.017806:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.017821:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.017835:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.017852:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.017870:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.017877:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020108:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020127:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020134:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020141:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271790.020145:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020153:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020170:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:2.0:1788271790.020173:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271790.020177:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020183:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020197:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020210:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020216:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020221:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271790.020225:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020231:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020240:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab6c4f64c00) 00010000:00010000:2.0:1788271790.020243:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271790.020245:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020251:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7b40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020297:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7b32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a51 expref: 15 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020308:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:2.0:1788271790.020310:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271790.020315:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a51 expref: 15 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.020324:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271790.020395:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:11370:x1875138574350848:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 2696us (2825us total) trans 0 rc 301/301 00000100:00100000:2.0:1788271790.020404:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00080000:2.0:1788271790.020457:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271790.033265:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.033352:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574351104 00000100:00100000:1.0:1788271790.033362:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574351104 00000100:00100000:1.0:1788271790.033450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 140 00000100:00100000:1.0:1788271790.033463:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:11370:x1875138574351104:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:1.0:1788271790.033517:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271790.033544:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f74b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102388a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.033561:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:1.0:1788271790.033566:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271790.033813:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.033826:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.033835:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.033873:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.033886:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 5 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271790.033899:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586939392:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271790.034547:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271790.038835:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271790.038900:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574351232 00000100:00100000:2.0:1788271790.038911:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574351232 00010000:00010000:2.0:1788271790.038985:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 6 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271790.039021:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:2.0:1788271790.039032:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2353:x1875138574351232:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271790.039047:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271790.039054:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 6 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.039068:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 6 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.039100:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:2.0:1788271790.039106:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.039117:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.039124:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.039141:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271790.039204:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2353:x1875138574351232:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 174us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271790.039211:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00080000:0.0:1788271790.039538:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788271790.040408:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7b08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a43 expref: 5 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271790.040617:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586939392:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271790.040641:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.040714:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.040721:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.040750:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.040763:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.040783:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271790.042628:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788271790.042709:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.042719:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.042726:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.042733:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271790.042737:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.042745:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.042760:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1100) 00010000:00010000:3.0:1788271790.042763:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271790.042768:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.042773:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7b47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271790.042792:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002feb2de8 reply state 000000005533b775 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271790.042812:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271790.042976:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:11370:x1875138574351104:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 9506us (9709us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788271790.042985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 140 00010000:00010000:1.0:1788271790.048348:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.048367:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.048376:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.048382:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271790.048387:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.048395:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.048583:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab6c3e3c100) 00010000:00010000:1.0:1788271790.048587:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271790.048593:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.048617:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7b4e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.066637:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271790.131239:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271790.132122:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574351360 00000100:00100000:0.0:1788271790.132134:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574351360 00000100:00100000:0.0:1788271790.132196:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 141 00000100:00100000:0.0:1788271790.132207:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+14:11378:x1875138574351360:12345-192.168.201.1@tcp:101:lctl.0 00010000:00010000:0.0:1788271790.132232:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271790.132255:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a58 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.132330:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7b5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.132343:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.132353:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271790.132467:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788271790.132471:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788271790.132497:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.132522:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a58 expref: 16 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.132540:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a58 expref: 15 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.132549:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:0.0:1788271790.132552:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271790.132556:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374a00, rc 0) 00000100:00100000:0.0:1788271790.132618:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:11378:x1875138574351360:12345-192.168.201.1@tcp:101:lctl.0 Request processed in 413us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271790.132625:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 141 00000100:00100000:0.0:1788271790.193726:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271790.195326:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574351488 00000100:00100000:2.0:1788271790.195340:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574351488 00000100:00100000:2.0:1788271790.195408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 142 00000100:00100000:2.0:1788271790.195447:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+15:11384:x1875138574351488:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271790.195466:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271790.195485:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a5f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195546:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195561:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195572:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195587:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195593:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195599:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195717:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195737:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195744:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271790.195778:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788271790.195782:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271790.195803:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195815:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195820:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195826:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195832:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271790.195836:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195843:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195855:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:2.0:1788271790.195858:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271790.195862:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195877:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7b6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195891:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195897:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195902:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195906:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ae00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271790.195910:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195915:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195923:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab6c4f64c00) 00010000:00010000:2.0:1788271790.195926:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271790.195928:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.195934:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7b71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.196247:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7b63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a5f expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.196263:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a5f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.196277:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271790.196279:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788271790.196282:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b800, rc 0) 00000100:00100000:2.0:1788271790.197356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:11384:x1875138574351488:12345-192.168.201.1@tcp:101:bash.0 Request processed in 1902us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271790.197369:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 142 00000100:00100000:3.0:1788271790.201527:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271790.204863:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574351744 00000100:00100000:0.0:1788271790.204885:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574351744 00000100:00100000:0.0:1788271790.204993:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 143 00000100:00100000:0.0:1788271790.205007:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+16:11384:x1875138574351744:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1788271790.205036:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271790.205065:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7b7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a66 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.205273:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.205308:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.205321:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.205374:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.205383:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.205391:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271790.206857:0:8302:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788271790.207078:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207106:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207186:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207236:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207244:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207252:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207273:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271790.207279:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207288:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207304:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:0.0:1788271790.207307:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271790.207313:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207320:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7b86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271790.207336:0:8302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d166d6c3 reply state 00000000bda5ce1a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271790.207348:0:8302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788271790.207393:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7b7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 19 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207647:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 18 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.207658:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:0.0:1788271790.207660:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271790.207663:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374400, rc 0) 00000100:00100000:0.0:1788271790.207770:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11384:x1875138574351744:12345-192.168.201.1@tcp:101:bash.0 Request processed in 2765us (6257us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788271790.207788:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 143 00000100:00100000:2.0:1788271790.212165:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271790.212711:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574351872 00000100:00100000:3.0:1788271790.212725:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574351872 00000100:00100000:3.0:1788271790.212879:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:3.0:1788271790.212891:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574351872:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271790.212917:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271790.212946:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a6d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271790.212983:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788271790.213009:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1788271790.213015:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271790.213027:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.213050:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.213067:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19a00, rc 0) 00000100:00100000:3.0:1788271790.213165:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2351:x1875138574351872:12345-192.168.201.1@tcp:101:bash.0 Request processed in 276us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271790.213197:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00010000:00010000:0.0:1788271790.214115:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.214137:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.214146:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.214153:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271790.214159:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.214167:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.214189:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c2fd1b00) 00010000:00010000:0.0:1788271790.214192:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271790.214197:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.214204:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7b8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788271790.214956:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271790.217740:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271790.217894:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574352000 00000100:00100000:0.0:1788271790.217907:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574352000 00000100:00100000:0.0:1788271790.217984:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:0.0:1788271790.217995:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:11384:x1875138574352000:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1788271790.218020:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271790.218064:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a74 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.218116:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.218136:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271790.218141:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271790.218146:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.218187:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.218200:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 7 pid: 6697 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271790.218213:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875138586939520:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271790.218331:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c85ded80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271790.222871:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.223052:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574352128 00000100:00100000:1.0:1788271790.223065:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574352128 00000100:00100000:0.0:1788271790.223611:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875138586939520:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271790.223684:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.223731:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374200, rc 0) 00000100:00100000:0.0:1788271790.223832:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:11384:x1875138574352000:12345-192.168.201.1@tcp:101:bash.0 Request processed in 5837us (6104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271790.223866:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00010000:00010000:1.0:1788271790.223890:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 7 pid: 6697 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271790.224116:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:1.0:1788271790.224134:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574352128:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271790.229047:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271790.229100:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 7 pid: 6697 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.229123:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 7 pid: 6697 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.229151:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000895454bf/0xbeb05ca97b5f7ba2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a6d expref: 7 pid: 6697 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.229173:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271790.229177:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271790.229187:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.229222:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.229278:0:8506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271790.229296:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1875138586939648:192.168.201.1@tcp:105: 00000100:00100000:1.0:1788271790.229523:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271790.234118:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1875138586939648:192.168.201.1@tcp:105: 00010000:00010000:1.0:1788271790.234145:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271790.236559:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574352128:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 12422us (13692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271790.236573:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:3.0:1788271790.240162:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271790.242591:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574352384 00000100:00100000:0.0:1788271790.242728:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574352384 00000100:00100000:0.0:1788271790.242926:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:0.0:1788271790.242938:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:11384:x1875138574352384:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:0.0:1788271790.243304:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11384:x1875138574352384:12345-192.168.201.1@tcp:35:bash.0 Request processed in 368us (3151us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788271790.243311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:2.0:1788271790.425123:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271790.425308:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574352640 00000100:00100000:3.0:1788271790.425320:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574352640 00000100:00100000:3.0:1788271790.425389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:3.0:1788271790.425399:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11394:x1875138574352640:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271790.429744:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271790.429778:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7bb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271790.429920:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788271790.430063:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7bb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a7b expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.430077:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:2.0:1788271790.430080:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271790.430235:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7bb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a7b expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.430262:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024be00, rc 0) 00000100:00100000:2.0:1788271790.430361:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11394:x1875138574352640:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 4962us (5250us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788271790.430400:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:3.0:1788271790.437233:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.437588:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574352896 00000100:00100000:1.0:1788271790.437598:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574352896 00000100:00100000:1.0:1788271790.437662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1788271790.437672:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11394:x1875138574352896:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1788271790.440184:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:11394:x1875138574352896:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 2500us (2948us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788271790.440200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:3.0:1788271790.526701:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.527719:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574353024 00000100:00100000:1.0:1788271790.527732:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574353024 00000100:00100000:1.0:1788271790.527802:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 145 00000100:00100000:1.0:1788271790.527814:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:11400:x1875138574353024:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271790.527847:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271790.527868:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a82 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.528153:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.528166:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.528178:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271790.528544:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788271790.528549:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271790.528571:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.528598:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a82 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.528616:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a82 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.528624:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271790.528627:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271790.528630:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6e00, rc 0) 00000100:00100000:1.0:1788271790.528693:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11400:x1875138574353024:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 881us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271790.528700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 145 00000100:00100000:2.0:1788271790.535849:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.539271:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574353280 00000100:00100000:1.0:1788271790.539287:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574353280 00000100:00100000:1.0:1788271790.539450:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 146 00000100:00100000:1.0:1788271790.539461:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eea78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11400:x1875138574353280:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271790.539482:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271790.539502:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7bcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a89 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.539599:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.539613:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.539636:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271790.539647:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788271790.539784:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7bcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a89 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.539803:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a89 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.539811:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:1.0:1788271790.539814:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271790.539817:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6200, rc 0) 00000100:00100000:1.0:1788271790.539906:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eea78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11400:x1875138574353280:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 447us (4068us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788271790.539931:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 146 00000100:00100000:3.0:1788271790.545351:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271790.545448:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271790.545537:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574353536 00000100:00100000:2.0:1788271790.545548:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574353536 00000100:00100000:1.0:1788271790.545692:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574353664 00000100:00100000:1.0:1788271790.545696:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574353664 00000100:00100000:1.0:1788271790.545745:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1788271790.545756:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+25:2354:x1875138574353664:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271790.545775:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271790.545802:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a89 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.545822:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:1.0:1788271790.545828:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271790.545901:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:2354:x1875138574353664:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 138us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271790.545909:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1788271790.547304:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 147 00000100:00100000:2.0:1788271790.547323:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11400:x1875138574353536:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271790.547349:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271790.547368:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7be1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a90 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.547479:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7be8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.547494:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.547504:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271790.547515:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788271790.547634:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7be1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a90 expref: 26 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.547652:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a90 expref: 25 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.547660:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:2.0:1788271790.547663:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788271790.547678:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024be00, rc 0) 00000100:00100000:2.0:1788271790.547725:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+25:11400:x1875138574353536:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 411us (2386us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788271790.547732:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 147 00000100:00100000:3.0:1788271790.559667:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271790.563502:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574353792 00000100:00100000:0.0:1788271790.563518:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574353792 00000100:00100000:0.0:1788271790.563655:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1788271790.563667:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2352:x1875138574353792:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:0.0:1788271790.563713:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.563736:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.563745:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271790.563750:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271790.563755:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.563795:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.563828:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 6 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271790.563845:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1875138586939776:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271790.563970:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271790.567592:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1875138586939776:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271790.567624:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271790.570768:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271790.570842:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574353920 00000100:00100000:2.0:1788271790.570858:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574353920 00002000:00100000:2.0:1788271790.571107:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ab6ca62b800 x1875138574353920/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:696/0 lens 504/0 e 0 to 0 dl 1788271801 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271790.571117:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ca62b800 with x1875138574353920 ext(0->12) 00010000:00010000:2.0:1788271790.571126:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 7 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.571144:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 7 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271790.571152:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6ca62b800 00000100:00100000:2.0:1788271790.571183:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:2.0:1788271790.571193:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574353920:12345-192.168.201.1@tcp:4:lfs.0 00000100:00100000:2.0:1788271790.572744:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2353:x1875138574353920:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 1545us (1983us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788271790.572756:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00002000:00100000:2.0:1788271790.572768:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ab6ca62b800 x1875138574353920/t4294967305(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:696/0 lens 504/448 e 0 to 0 dl 1788271801 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271790.572778:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6ca62b800 with x1875138574353920 ext(0->12) 00010000:00010000:2.0:1788271790.572786:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 9 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.572819:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 9 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271790.572827:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6ca62b800 00000100:00100000:2.0:1788271790.587330:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271790.587466:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574354048 00000100:00100000:3.0:1788271790.587477:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574354048 00010000:00010000:3.0:1788271790.587521:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 9 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271790.587610:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:3.0:1788271790.587621:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574354048:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271790.587636:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788271790.587665:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788271790.587669:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788271789 00002000:00010000:3.0:1788271790.587672:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788271789 00002000:00010000:3.0:1788271790.587674:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788271789 00010000:00010000:3.0:1788271790.587680:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 9 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.587705:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 9 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.587726:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a830987/0xbeb05ca97b5f7ba9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x769326461023a74 expref: 9 pid: 8463 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.587742:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271790.587746:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271790.587751:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.587762:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.587795:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271790.587852:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574354048:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 234us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271790.587859:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00010000:00010000:0.0:1788271790.587925:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.587935:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.587959:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.587978:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.587987:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.588014:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271790.588018:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.588027:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.588040:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.588047:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7bf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271790.588103:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2352:x1875138574353792:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 24439us (28699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271790.588111:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:2.0:1788271790.596641:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271790.599600:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574354304 00000100:00100000:3.0:1788271790.599614:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574354304 00000100:00100000:2.0:1788271790.603734:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:2.0:1788271790.603751:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+25:11400:x1875138574354304:12345-192.168.201.1@tcp:35:lfs.0 00000004:00010000:2.0:1788271790.603827:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a90 expref: 25 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271790.604144:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788271790.604189:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788271790.604808:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788271790.604857:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.604872:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 29 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.604880:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.604915:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 29 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.604929:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 29 pid: 8302 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271790.604950:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875138586939904:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271790.605039:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab700217000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271790.610509:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875138586939904:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271790.610539:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271790.610959:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271790.611211:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574354432 00000100:00100000:3.0:1788271790.611219:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574354432 00010000:00010000:3.0:1788271790.611256:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 30 pid: 8302 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271790.611296:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:3.0:1788271790.611318:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:2353:x1875138574354432:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271790.611334:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271790.611341:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 30 pid: 8302 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.611354:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 30 pid: 8302 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.611377:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023a66 expref: 30 pid: 8302 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.611396:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:3.0:1788271790.611402:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.611448:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.611455:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271790.611475:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271790.611521:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:2353:x1875138574354432:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 205us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271790.611530:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00010000:00010000:0.0:1788271790.611707:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.611714:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271790.611838:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788271790.612066:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788271790.612187:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586940032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788271790.612234:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271790.612263:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788271790.612645:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586940032 00000100:00100000:3.0:1788271790.612652:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586940032 00000100:00100000:3.0:1788271790.612696:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271790.612706:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5841:x1875138586940032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788271790.612787:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5841:x1875138586940032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271790.612795:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271790.613145:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff34ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586940032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788271790.613603:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788271790.613670:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6cab9aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586940160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788271790.613714:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271790.613739:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271790.613813:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586940160 00000100:00100000:3.0:1788271790.613819:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586940160 00000100:00100000:3.0:1788271790.613857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271790.613877:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875138586940160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788271790.622226:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875138586940160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 8350us (8501us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788271790.622242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271790.622477:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6cab9aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875138586940160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788271790.622568:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788271790.622617:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.622638:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.622646:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.622651:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271790.622656:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.622678:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.622695:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:1.0:1788271790.622698:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788271790.622704:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.622710:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7bfd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271790.623080:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788271790.623196:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788271790.623207:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353804793229ns, next at 354804790894ns, rc = 0 00000001:00080000:1.0:1788271790.623213:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788271790.623245:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1300) 00010000:00010000:1.0:1788271790.623248:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788271790.623255:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7be8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a90 expref: 33 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271790.623349:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11400:x1875138574354304:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 19602us (26717us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788271790.623358:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000020:00080000:1.0:1788271790.623362:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788271790.632640:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.635725:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574354560 00000100:00100000:1.0:1788271790.635739:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574354560 00000100:00100000:0.0:1788271790.641534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 148 00000100:00100000:0.0:1788271790.641552:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11400:x1875138574354560:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271790.641579:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271790.641604:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7c04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a97 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.641668:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a97 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.641683:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a97 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.641704:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:0.0:1788271790.641707:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271790.641710:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375e00, rc 0) 00000100:00100000:0.0:1788271790.641794:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+33:11400:x1875138574354560:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 248us (9164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271790.641802:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 148 00000100:00100000:2.0:1788271790.646104:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.646239:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574354816 00000100:00100000:1.0:1788271790.646249:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574354816 00000100:00100000:1.0:1788271790.646312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1788271790.646336:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+33:11400:x1875138574354816:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1788271790.646620:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:11400:x1875138574354816:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 285us (523us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788271790.646630:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:3.0:1788271790.727635:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.727761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574355072 00000100:00100000:1.0:1788271790.727771:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574355072 00000100:00100000:1.0:1788271790.727833:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 149 00000100:00100000:1.0:1788271790.727843:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:11410:x1875138574355072:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271790.727868:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271790.727888:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7c0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023a9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271790.728397:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788271790.728611:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7c0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a9e expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.728627:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:1.0:1788271790.728630:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271790.728634:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a9e expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.728648:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6200, rc 0) 00000100:00100000:1.0:1788271790.728755:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:11410:x1875138574355072:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 913us (1130us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1788271790.728763:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 149 00000100:00100000:2.0:1788271790.738531:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.738633:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574355200 00000100:00100000:1.0:1788271790.738657:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574355200 00000100:00100000:1.0:1788271790.738707:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 150 00000100:00100000:1.0:1788271790.738718:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:11410:x1875138574355200:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1788271790.738792:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738811:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738824:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738839:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738845:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738851:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738958:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738967:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.738974:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271790.739028:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739052:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739058:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739065:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739070:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271790.739075:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739092:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739106:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271790.739109:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271790.739114:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739124:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739136:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739142:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739148:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739159:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271790.739162:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739168:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739177:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271790.739180:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271790.739182:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739187:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739201:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739207:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739212:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739217:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271790.739219:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739225:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739241:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:1.0:1788271790.739243:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271790.739246:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271790.739250:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271790.739324:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:11410:x1875138574355200:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 607us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271790.739332:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 150 00000100:00100000:2.0:1788271790.747021:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271790.747158:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574355456 00000100:00100000:1.0:1788271790.747168:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574355456 00000100:00100000:1.0:1788271790.747227:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:1.0:1788271790.747237:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:11410:x1875138574355456:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1788271790.747510:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:11410:x1875138574355456:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 273us (499us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788271790.747519:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:3.0:1788271790.788749:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271790.789567:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574355712 00000100:00100000:2.0:1788271790.789579:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574355712 00000100:00100000:2.0:1788271790.789646:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 151 00000100:00100000:2.0:1788271790.789658:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:11413:x1875138574355712:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271790.789686:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271790.789710:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7c2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023aa5 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.789820:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.789833:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.789844:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.789869:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.789876:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.789884:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790282:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790293:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790301:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271790.790312:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788271790.790598:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790607:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790614:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790620:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271790.790624:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790644:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790658:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271790.790661:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271790.790666:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790673:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790689:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790695:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790702:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790707:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271790.790710:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790716:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790722:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c4f64c00) 00010000:00010000:2.0:1788271790.790724:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271790.790727:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790739:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790783:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7c2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 39 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790798:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 38 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271790.790806:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271790.790808:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271790.790811:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ba00, rc 0) 00000100:00100000:2.0:1788271790.790897:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:11413:x1875138574355712:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1241us (2159us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788271790.790905:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 151 00000100:00100000:2.0:1788271790.796950:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271790.800578:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574355840 00000100:00100000:0.0:1788271790.800593:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574355840 00000100:00100000:0.0:1788271790.800679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 152 00000100:00100000:0.0:1788271790.800690:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:11413:x1875138574355840:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:0.0:1788271790.800770:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800787:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800798:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800824:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800831:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800837:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800844:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271790.800848:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800855:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800886:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:0.0:1788271790.800889:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271790.800894:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271790.800900:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7c51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271790.800989:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:11413:x1875138574355840:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 301us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271790.800998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 152 00000100:00100000:2.0:1788271790.810938:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271790.811095:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574356096 00000100:00100000:0.0:1788271790.811104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574356096 00000100:00100000:0.0:1788271790.811157:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:0.0:1788271790.811168:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:11413:x1875138574356096:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271790.812049:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:11413:x1875138574356096:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 877us (1115us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788271790.812059:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:3.0:1788271791.040538:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271791.040643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574356352 00000100:00100000:1.0:1788271791.040652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574356352 00000100:00100000:1.0:1788271791.040754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 153 00000100:00100000:1.0:1788271791.040764:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:11444:x1875138574356352:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:1.0:1788271791.040786:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271791.040805:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023aac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.040888:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.040910:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.040923:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271791.040934:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788271791.041056:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aac expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.041106:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aac expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.041115:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:1.0:1788271791.041118:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271791.041121:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6600, rc 0) 00000100:00100000:1.0:1788271791.041181:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:11444:x1875138574356352:12345-192.168.201.1@tcp:101:cat.0 Request processed in 418us (651us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788271791.041189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 153 00000100:00100000:2.0:1788271791.046098:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271791.046200:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271791.046296:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574356608 00000100:00100000:0.0:1788271791.046307:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574356608 00000100:00100000:0.0:1788271791.046358:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:0.0:1788271791.046369:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:11444:x1875138574356608:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:0.0:1788271791.046637:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:11444:x1875138574356608:12345-192.168.201.1@tcp:35:cat.0 Request processed in 269us (559us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788271791.046646:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:3.0:1788271791.047517:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574356736 00000100:00100000:3.0:1788271791.047524:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574356736 00000100:00100000:3.0:1788271791.047618:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:3.0:1788271791.047629:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:2353:x1875138574356736:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271791.047641:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271791.047665:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aac expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.047752:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271791.047757:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271791.047803:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:2353:x1875138574356736:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 175us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271791.047809:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00010000:00010000:0.0:1788271791.090800:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271791.137509:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271791.138007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574356992 00000100:00100000:2.0:1788271791.138018:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574356992 00000100:00100000:2.0:1788271791.138094:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 154 00000100:00100000:2.0:1788271791.138105:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:11450:x1875138574356992:12345-192.168.201.1@tcp:101:dd.0 00010000:00010000:2.0:1788271791.138129:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271791.138132:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788271791.138159:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a82 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.138201:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271791.138206:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271791.138221:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023ab3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.138379:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.138394:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 41 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.138409:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.138498:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 41 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.138512:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 41 pid: 8302 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271791.138526:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586940288:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271791.138624:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab700217900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271791.144765:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586940288:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271791.144797:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271791.145269:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271791.145491:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574357120 00000100:00100000:3.0:1788271791.145501:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574357120 00010000:00010000:3.0:1788271791.145544:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 42 pid: 8302 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271791.145610:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:3.0:1788271791.145620:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:2354:x1875138574357120:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271791.145643:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271791.145653:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 42 pid: 8302 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.145669:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 42 pid: 8302 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.145697:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023aa5 expref: 42 pid: 8302 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.145717:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271791.145724:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.145736:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.145744:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.145775:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271791.145846:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:2354:x1875138574357120:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 227us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271791.145854:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00010000:00010000:2.0:1788271791.147162:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.147187:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271791.147208:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788271791.147450:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7c6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.147472:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.147481:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271791.147484:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271791.147487:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271791.147559:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:11450:x1875138574356992:12345-192.168.201.1@tcp:101:dd.0 Request processed in 9455us (10060us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788271791.147568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 154 00000100:00100000:0.0:1788271791.153109:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271791.153187:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574357376 00000100:00100000:2.0:1788271791.153197:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574357376 00000100:00100000:2.0:1788271791.153260:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 155 00000100:00100000:2.0:1788271791.153270:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+41:11450:x1875138574357376:12345-192.168.201.1@tcp:36:dd.0 00010000:00010000:2.0:1788271791.153603:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.153622:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.153634:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271791.153837:0:8302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788271791.153856:0:8302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f075610 reply state 00000000ed1a9126 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271791.153863:0:8302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271791.153943:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+44:11450:x1875138574357376:12345-192.168.201.1@tcp:36:dd.0 Request processed in 675us (845us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788271791.153948:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 155 00000020:00080000:2.0:1788271791.153952:0:8302:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788271791.157277:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.157300:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.157307:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.157314:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271791.157333:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.157341:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.157359:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:1.0:1788271791.157372:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271791.157376:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.157382:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7c82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271791.532965:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271791.533152:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574357504 00000100:00100000:1.0:1788271791.533160:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574357504 00000100:00100000:1.0:1788271791.533217:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 156 00000100:00100000:1.0:1788271791.533227:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+43:11464:x1875138574357504:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:1.0:1788271791.533264:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271791.533302:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7c89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023aba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533376:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533388:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533396:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533451:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533466:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533474:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533597:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533606:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533611:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533637:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.533647:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 44 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271791.533656:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586940416:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271791.533759:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271791.536668:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c9f79880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586940416:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271791.536699:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271791.539327:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271791.539592:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574357760 00000100:00100000:1.0:1788271791.539615:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574357760 00000100:00100000:1.0:1788271791.539675:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:1.0:1788271791.539685:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:5594:x1875138574357760:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788271791.540250:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:5594:x1875138574357760:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 564us (930us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788271791.540259:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:0.0:1788271791.543667:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271791.543887:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574357888 00000100:00100000:2.0:1788271791.543898:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574357888 00010000:00010000:2.0:1788271791.543939:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 46 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271791.544050:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:2.0:1788271791.544058:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:2353:x1875138574357888:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271791.544083:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271791.544094:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 46 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.544108:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 46 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.544129:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7c74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ab3 expref: 46 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.544144:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271791.544159:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.544165:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.544170:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.544234:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271791.544288:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:2353:x1875138574357888:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 229us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271791.544296:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00010000:00010000:1.0:1788271791.544976:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.544984:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271791.545027:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788271791.545030:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271791.545047:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545058:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545075:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545080:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545085:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545089:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271791.545092:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545109:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545121:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271791.545124:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271791.545127:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545133:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f7c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545144:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545150:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545156:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545161:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271791.545164:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545170:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545175:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271791.545178:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271791.545181:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545197:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7c97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545236:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7c89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aba expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545249:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aba expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.545256:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:1.0:1788271791.545258:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271791.545260:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6e00, rc 0) 00000100:00100000:1.0:1788271791.545347:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+44:11464:x1875138574357504:12345-192.168.201.1@tcp:101:stat.0 Request processed in 12121us (12393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271791.545355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 156 00000100:00100000:0.0:1788271791.637824:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271791.637912:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574358144 00000100:00100000:3.0:1788271791.637931:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574358144 00000100:00100000:3.0:1788271791.637986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 157 00000100:00100000:3.0:1788271791.637996:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+44:11470:x1875138574358144:12345-192.168.201.1@tcp:36:truncate.0 00010000:00010000:3.0:1788271791.638055:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271791.638093:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7c9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aba expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.638112:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271791.638117:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271791.638344:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.638357:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.638366:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271791.638450:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788271791.638477:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed3088e9 reply state 0000000065e03af0 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271791.638487:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271791.638579:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:11470:x1875138574358144:12345-192.168.201.1@tcp:36:truncate.0 Request processed in 584us (764us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788271791.638586:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 157 00000020:00080000:3.0:1788271791.638591:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271791.645459:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.645479:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.645486:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.645491:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271791.645497:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.645504:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.645523:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271791.645527:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271791.645532:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.645555:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7ca5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271791.661374:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788271791.661394:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1788271791.732727:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271791.732767:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271791.732803:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271791.732838:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271791.732875:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574358272 00000100:00100000:0.0:1788271791.732875:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574358400 00000100:00100000:3.0:1788271791.732885:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574358272 00000100:00100000:0.0:1788271791.732885:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574358400 00000100:00100000:3.0:1788271791.732941:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 290 00000100:00100000:0.0:1788271791.732945:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574358528 00000100:00100000:0.0:1788271791.732949:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574358528 00000100:00100000:3.0:1788271791.732969:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574358272:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271791.732983:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:0.0:1788271791.732993:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574358400:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271791.733055:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2353:x1875138574358400:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271791.733071:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:0.0:1788271791.733087:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:0.0:1788271791.733094:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574358528:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271791.733344:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574358656 00000100:00100000:2.0:1788271791.733349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574358656 00000100:00100000:2.0:1788271791.733378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:2.0:1788271791.733384:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574358656:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271791.734668:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574358272:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 1698us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271791.734678:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 290 00000100:00080000:3.0:1788271791.734800:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271791.740952:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574358528:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 7846us (8100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271791.740984:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:2.0:1788271791.743281:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574358656:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 9887us (10503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271791.743294:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:0.0:1788271791.781898:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271791.782019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574358784 00000100:00100000:3.0:1788271791.782030:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574358784 00000100:00100000:3.0:1788271791.782099:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:3.0:1788271791.782110:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:11484:x1875138574358784:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:3.0:1788271791.782135:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271791.782156:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023ac1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782218:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782232:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782243:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782258:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782265:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782271:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782382:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782391:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782398:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271791.782477:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788271791.782482:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271791.782504:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782516:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782524:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782530:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782536:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782542:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271791.782547:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782553:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782570:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271791.782573:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271791.782577:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782583:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782596:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782602:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782607:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782611:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271791.782614:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782620:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782625:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271791.782627:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271791.782630:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782636:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7cba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782678:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782691:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.782697:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271791.782699:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271791.782702:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19000, rc 0) 00000100:00100000:3.0:1788271791.783097:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:11484:x1875138574358784:12345-192.168.201.1@tcp:101:stat.0 Request processed in 988us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271791.783105:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:0.0:1788271791.891923:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271791.892096:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574359040 00000100:00100000:1.0:1788271791.892107:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574359040 00000100:00100000:1.0:1788271791.892175:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 159 00000100:00100000:1.0:1788271791.892188:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+46:11494:x1875138574359040:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271791.892209:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271791.892231:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023ac8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271791.892345:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788271791.892511:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7cc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ac8 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.892539:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:1.0:1788271791.892543:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271791.892548:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f7cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ac8 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.892561:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6600, rc 0) 00000100:00100000:1.0:1788271791.892628:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:11494:x1875138574359040:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 443us (715us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788271791.892636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 159 00000100:00100000:1.0:1788271791.900198:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271791.900554:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574359296 00000100:00100000:0.0:1788271791.900565:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574359296 00000100:00100000:0.0:1788271791.900631:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1788271791.900641:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:11494:x1875138574359296:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271791.900901:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+48:11494:x1875138574359296:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 261us (714us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788271791.900908:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1788271791.964823:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271791.964920:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574359552 00000100:00100000:2.0:1788271791.964930:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574359552 00000100:00100000:2.0:1788271791.965001:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 160 00000100:00100000:2.0:1788271791.965012:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+48:11500:x1875138574359552:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271791.965034:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271791.965055:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7cd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023acf expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.965168:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.965185:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.965194:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.965245:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.965259:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 49 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271791.965274:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586940544:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271791.965481:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7403240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271791.978467:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271791.978489:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586940544:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271791.978528:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271791.978869:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574359680 00000100:00100000:3.0:1788271791.978877:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574359680 00010000:00010000:3.0:1788271791.978914:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 50 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271791.978951:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:3.0:1788271791.978980:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:2354:x1875138574359680:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271791.978996:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271791.979003:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 50 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.979015:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 50 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.979057:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ac1 expref: 50 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.979081:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271791.979086:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.979095:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.979101:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271791.979128:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271791.979185:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:2354:x1875138574359680:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 208us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271791.979193:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00010000:00010000:0.0:1788271791.980876:0:8302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271791.980888:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271791.980908:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788271791.981179:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7cd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 50 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271791.981201:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 49 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271791.981210:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:0.0:1788271791.981213:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788271791.981216:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ac00, rc 0) 00000100:00100000:0.0:1788271791.981292:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:11500:x1875138574359552:12345-192.168.201.1@tcp:101:bash.0 Request processed in 16282us (16477us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788271791.981301:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 160 00000100:00100000:2.0:1788271791.989288:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271791.989391:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574359936 00000100:00100000:1.0:1788271791.989402:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574359936 00000100:00100000:1.0:1788271791.989498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 161 00000100:00100000:1.0:1788271791.989509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+49:11500:x1875138574359936:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:1.0:1788271791.989787:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.989805:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271791.989816:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271791.989869:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788271791.989894:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4d21b9f reply state 0000000001e7582b transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271791.989902:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271791.991016:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:11500:x1875138574359936:12345-192.168.201.1@tcp:36:bash.0 Request processed in 1501us (1729us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788271791.991027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 161 00000020:00080000:1.0:1788271791.991033:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271791.996679:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.996698:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.996705:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.996712:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271791.996717:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.996724:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.996742:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271791.996745:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271791.996750:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271791.996771:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f7ceb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271792.000829:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271792.001109:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574360064 00000100:00100000:3.0:1788271792.001120:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574360064 00000100:00100000:3.0:1788271792.001198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 162 00000100:00100000:3.0:1788271792.001207:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:11500:x1875138574360064:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271792.001230:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271792.001252:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023ad6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.001333:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.001366:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 52 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.001374:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.001778:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 52 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.001795:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 52 pid: 8302 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271792.001809:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586940672:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271792.001904:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab700217600 going to sleep for 11 seconds 00000100:00080000:2.0:1788271792.002293:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271792.006480:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271792.006483:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586940672:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271792.006638:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574360192 00000100:00100000:2.0:1788271792.006646:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574360192 00010000:00010000:2.0:1788271792.006685:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 53 pid: 8302 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271792.006728:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:2.0:1788271792.006738:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:2353:x1875138574360192:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271792.006753:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271792.006761:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 53 pid: 8302 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.006774:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 53 pid: 8302 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.006794:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7cdd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023acf expref: 53 pid: 8302 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.006811:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271792.006817:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.006827:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.006846:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.006863:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271792.006935:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:2353:x1875138574360192:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 197us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271792.006943:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 68 00010000:00010000:3.0:1788271792.007273:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.007284:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.007290:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271792.007333:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788271792.007337:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271792.007352:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.007391:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7cf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ad6 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.007406:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ad6 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.007457:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271792.007460:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271792.007463:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18e00, rc 0) 00000100:00100000:3.0:1788271792.007489:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:11500:x1875138574360064:12345-192.168.201.1@tcp:101:bash.0 Request processed in 6283us (6671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271792.007496:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 162 00000100:00100000:0.0:1788271792.014093:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271792.014453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574360448 00000100:00100000:2.0:1788271792.014462:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574360448 00000100:00100000:2.0:1788271792.014517:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:2.0:1788271792.014525:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:11500:x1875138574360448:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1788271792.014722:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:11500:x1875138574360448:12345-192.168.201.1@tcp:35:bash.0 Request processed in 197us (640us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788271792.014727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00010000:00010000:1.0:1788271792.114531:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271792.143634:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271792.143701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574360704 00000100:00100000:0.0:1788271792.143711:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574360704 00000100:00100000:0.0:1788271792.143776:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00100000:0.0:1788271792.143789:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:11510:x1875138574360704:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271792.143814:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271792.143834:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7d00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023add expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271792.144134:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1788271792.144339:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7d00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023add expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.144353:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:0.0:1788271792.144356:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271792.144360:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375400/0xbeb05ca97b5f7d00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023add expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.144373:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375400, rc 0) 00000100:00100000:0.0:1788271792.144446:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:11510:x1875138574360704:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 660us (820us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788271792.144453:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00100000:0.0:1788271792.150578:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271792.150644:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574360832 00000100:00100000:3.0:1788271792.150654:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574360832 00000100:00100000:3.0:1788271792.150721:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:3.0:1788271792.150731:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:11510:x1875138574360832:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:3.0:1788271792.150819:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.150836:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.150846:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.150860:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.150884:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.150891:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151208:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151217:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151224:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271792.151263:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151275:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151281:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151287:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151293:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271792.151297:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151304:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151323:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271792.151326:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271792.151331:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151337:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151349:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151355:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151359:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151364:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271792.151366:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151371:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151378:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271792.151380:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271792.151383:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151388:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151442:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151449:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151455:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151460:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271792.151463:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151469:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151477:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271792.151480:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271792.151482:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.151487:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271792.151557:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:11510:x1875138574360832:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 827us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271792.151565:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:2.0:1788271792.156251:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271792.156324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574361088 00000100:00100000:1.0:1788271792.156333:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574361088 00000100:00100000:1.0:1788271792.156394:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:1.0:1788271792.156406:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+53:11510:x1875138574361088:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1788271792.156865:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:11510:x1875138574361088:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 460us (622us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788271792.156873:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000001:00080000:3.0:1788271792.195774:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000020:00080000:3.0:1788271792.195801:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab6e59b0300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788271792.195806:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6ff6e2b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6e59b0180 00000020:00080000:3.0:1788271792.195823:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6ff6e2800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6e58b8000 00000001:00080000:3.0:1788271792.195850:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000004:00080000:3.0:1788271792.195871:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788271792.195895:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000100:00100000:3.0:1788271792.196045:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586940800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788271792.196119:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271792.196196:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586940800 00000100:00100000:3.0:1788271792.196204:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586940800 00000100:00100000:3.0:1788271792.196258:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788271792.196266:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586940800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788271792.196291:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788271792.196689:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a96dcad, atime: 0x6a96dcad, ctime: 0x6a96dcad, blocks: 0xb 00010000:00010000:3.0:1788271792.196698:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.196715:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788271792.196719:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271792.196725:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.196740:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.196751:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.196758:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.196785:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271792.197351:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586940800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1083us (1230us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788271792.197359:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788271792.197388:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1788271792.197795:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788271792.197900:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788271792.198007:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788271792.198013:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788271792.198033:0:3279:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab6f745df80 x1875138586940800/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788271808 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788271792.198045:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6f745df80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788271792.198051:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586940800:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788271792.198100:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271792.198108:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.198117:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271792.198122:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.198131:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.198151:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.198157:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000660576d6/0xbeb05ca97b5f7d23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.198175:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271792.198177:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271792.198178:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271792.214304:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271792.214767:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574361344 00000100:00100000:0.0:1788271792.214783:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574361344 00000100:00100000:0.0:1788271792.214855:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 165 00000100:00100000:0.0:1788271792.214865:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:11513:x1875138574361344:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271792.214892:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271792.214912:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7d2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023ae4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.214988:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215002:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215014:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215028:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215035:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215040:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215476:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7d3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215487:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215495:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271792.215513:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788271792.215602:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215609:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215616:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215622:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271792.215626:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215635:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215647:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:0.0:1788271792.215650:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271792.215654:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215660:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215672:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215677:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215694:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215699:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271792.215702:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215708:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215715:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c2fd1600) 00010000:00010000:0.0:1788271792.215717:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271792.215720:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215724:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215765:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7d2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ae4 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215779:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ae4 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.215785:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:0.0:1788271792.215788:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271792.215790:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374200, rc 0) 00000100:00100000:0.0:1788271792.215875:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11513:x1875138574361344:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1011us (1589us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788271792.215892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 165 00000100:00100000:0.0:1788271792.223357:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271792.223882:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574361472 00000100:00100000:3.0:1788271792.223894:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574361472 00000100:00100000:2.0:1788271792.224502:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 166 00000100:00100000:2.0:1788271792.224515:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11513:x1875138574361472:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:2.0:1788271792.224617:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224637:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224650:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224679:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224687:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224693:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224699:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271792.224704:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224712:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224725:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271792.224728:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271792.224733:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.224739:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271792.224825:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11513:x1875138574361472:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 312us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271792.224833:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 166 00000100:00100000:3.0:1788271792.224924:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271792.224960:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574361600 00000100:00100000:3.0:1788271792.224966:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574361600 00000100:00100000:3.0:1788271792.225002:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271792.225012:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:2352:x1875138574361600:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271792.225023:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271792.225040:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f7d3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ae4 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.225053:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:3.0:1788271792.225269:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271792.225307:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:2352:x1875138574361600:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 297us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271792.225316:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:1.0:1788271792.229201:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271792.229363:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574361856 00000100:00100000:2.0:1788271792.229374:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574361856 00000100:00100000:2.0:1788271792.229639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:2.0:1788271792.229649:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11513:x1875138574361856:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271792.229871:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11513:x1875138574361856:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 223us (680us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788271792.229879:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:2.0:1788271792.423358:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271792.423459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574362112 00000100:00100000:0.0:1788271792.423470:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574362112 00000100:00100000:0.0:1788271792.423572:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 167 00000100:00100000:0.0:1788271792.423583:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11531:x1875138574362112:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:0.0:1788271792.423605:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271792.423625:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023aeb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.423727:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.423742:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.423752:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271792.423764:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788271792.423880:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7d54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aeb expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.423894:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aeb expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271792.423900:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:0.0:1788271792.423902:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788271792.423915:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375000, rc 0) 00000100:00100000:0.0:1788271792.423971:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11531:x1875138574362112:12345-192.168.201.1@tcp:101:cat.0 Request processed in 389us (623us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788271792.423978:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 167 00000100:00100000:0.0:1788271792.470651:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271792.471102:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574362240 00000100:00100000:3.0:1788271792.471114:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574362240 00000100:00100000:3.0:1788271792.471231:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:3.0:1788271792.471242:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11532:x1875138574362240:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271792.471266:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271792.471286:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023af2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.471347:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.471359:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.471380:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271792.471584:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788271792.471587:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271792.471653:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.471681:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7d69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023af2 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.471698:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023af2 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271792.471707:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271792.471710:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271792.471714:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19c00, rc 0) 00000100:00100000:3.0:1788271792.471771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11532:x1875138574362240:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 531us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271792.471776:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:1.0:1788271792.478564:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271792.478843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574362624 00000100:00100000:2.0:1788271792.478853:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574362624 00000100:00100000:2.0:1788271792.478939:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:2.0:1788271792.478949:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11532:x1875138574362624:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271792.479362:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11532:x1875138574362624:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 412us (824us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788271792.479370:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:0.0:1788271792.488016:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271792.488098:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574362752 00000100:00100000:2.0:1788271792.488109:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574362752 00000100:00100000:2.0:1788271792.488185:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:2.0:1788271792.488196:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11532:x1875138574362752:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:2.0:1788271792.488213:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788271792.488238:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ad6 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.488281:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023aeb expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.488295:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a97 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.488306:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c2fd1b00) 00010000:00010000:2.0:1788271792.488318:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271792.488585:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:11532:x1875138574362752:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 390us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271792.488594:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1788271792.495934:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271792.496079:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574362880 00000100:00100000:2.0:1788271792.496089:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574362880 00000100:00100000:2.0:1788271792.496149:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00100000:2.0:1788271792.496160:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:11532:x1875138574362880:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:2.0:1788271792.496257:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.496272:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.496283:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271792.496618:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788271792.496691:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:11532:x1875138574362880:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 533us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271792.496708:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00100000:1.0:1788271792.521124:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271792.521223:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574363008 00000100:00100000:2.0:1788271792.521233:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574363008 00000100:00100000:2.0:1788271792.521284:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 170 00000100:00100000:2.0:1788271792.521291:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:11534:x1875138574363008:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271792.521308:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271792.521324:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023af9 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521375:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521385:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521404:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521457:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521464:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521468:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521801:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521816:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521821:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271792.521852:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788271792.521855:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271792.521872:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521882:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521891:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521897:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521904:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521911:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271792.521915:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521921:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521930:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271792.521932:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271792.521940:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521945:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7d85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521956:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521959:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521963:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521967:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271792.521968:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521971:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521975:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271792.521976:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271792.521978:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.521981:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.522003:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 23 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.522019:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 22 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271792.522024:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c4f64c00) 00010000:00010000:2.0:1788271792.522026:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271792.522027:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a600, rc 0) 00000100:00100000:2.0:1788271792.522105:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11534:x1875138574363008:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 813us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271792.522112:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 170 00010000:00010000:1.0:1788271793.143568:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788271793.332485:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271793.332494:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271793.332531:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788271793.332537:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788271793.332668:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586940928:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788271793.332763:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271793.352703:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586940928:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788271793.354837:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.358734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574363136 00000100:00100000:3.0:1788271793.358750:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574363136 00000100:00100000:3.0:1788271793.358881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 171 00000100:00100000:3.0:1788271793.358893:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11545:x1875138574363136:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788271793.358926:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788271793.359056:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11545:x1875138574363136:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 164us (4228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271793.359074:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 171 00000100:00100000:0.0:1788271793.366999:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.367966:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574363264 00000100:00100000:2.0:1788271793.367978:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574363264 00000100:00100000:2.0:1788271793.368073:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 172 00000100:00100000:2.0:1788271793.368083:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11545:x1875138574363264:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788271793.368161:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368177:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368189:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368215:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368223:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368229:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368283:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368292:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368298:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271793.368336:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788271793.368340:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271793.368354:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368366:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.368372:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.369514:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.369544:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271793.369550:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.369559:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.369575:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:2.0:1788271793.369579:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271793.370200:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370210:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7d9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370230:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370237:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370244:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370250:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271793.370254:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370261:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370281:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271793.370284:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271793.370288:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370294:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7da1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370313:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370320:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370326:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370330:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271793.370333:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370339:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370345:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c4f64c00) 00010000:00010000:2.0:1788271793.370348:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271793.370351:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.370356:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.370502:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11545:x1875138574363264:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 2416us (3508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271793.370513:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 172 00000100:00100000:1.0:1788271793.376404:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.376565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574363520 00000100:00100000:3.0:1788271793.376576:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574363520 00000100:00100000:3.0:1788271793.376648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:3.0:1788271793.376659:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11545:x1875138574363520:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271793.376680:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271793.376703:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7daf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b00 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.376816:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.376831:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.376844:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271793.376855:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788271793.376955:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.376962:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.376968:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.376974:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271793.376978:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.376992:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.377005:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c4f64c00) 00010000:00010000:3.0:1788271793.377008:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271793.377013:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.377020:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7db6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.377288:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7daf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b00 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.377301:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:3.0:1788271793.377304:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271793.377309:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7daf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b00 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.377321:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19000, rc 0) 00000100:00100000:3.0:1788271793.377390:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11545:x1875138574363520:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 733us (1014us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788271793.377398:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:3.0:1788271793.389027:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271793.389124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574363648 00000100:00100000:0.0:1788271793.389133:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574363648 00000100:00100000:0.0:1788271793.389196:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:0.0:1788271793.389206:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11545:x1875138574363648:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788271793.389242:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788271793.389355:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11545:x1875138574363648:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 150us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271793.389363:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:1.0:1788271793.401075:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.401827:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574363904 00000100:00100000:2.0:1788271793.401847:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574363904 00000100:00100000:2.0:1788271793.401919:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:2.0:1788271793.401931:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11545:x1875138574363904:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271793.401953:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271793.401957:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788271793.401985:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023af2 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.402005:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271793.402010:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271793.402023:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b07 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788271793.402961:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788271793.403602:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.403617:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.403629:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.403696:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b07 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.403722:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b07 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.403730:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271793.403733:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271793.403736:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a800, rc 0) 00000100:00100000:2.0:1788271793.403818:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11545:x1875138574363904:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1888us (2754us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788271793.403826:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:1.0:1788271793.410559:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271793.411506:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574364160 00000100:00100000:0.0:1788271793.411517:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574364160 00000100:00100000:0.0:1788271793.411568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:0.0:1788271793.411577:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11545:x1875138574364160:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788271793.411634:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271793.411662:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7dcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b07 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.411682:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:0.0:1788271793.411693:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271793.411715:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.411740:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.411750:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.411766:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.411774:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.411780:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412051:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412059:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412067:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412073:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271793.412078:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412086:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412096:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:0.0:1788271793.412105:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271793.412109:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412116:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7dd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412127:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412132:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412138:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412142:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271793.412145:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412151:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412159:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb51777a (ffff8ab6c2fd1c00) 00010000:00010000:0.0:1788271793.412161:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271793.412163:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.412169:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7de0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb51777a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271793.412249:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11545:x1875138574364160:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 672us (1699us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271793.412267:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:0.0:1788271793.432190:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.434185:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574364288 00000100:00100000:3.0:1788271793.434203:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574364288 00000100:00100000:3.0:1788271793.434278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 177 00000100:00100000:3.0:1788271793.434290:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11545:x1875138574364288:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271793.434321:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271793.434347:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7de7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.434395:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.434431:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.434444:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.434541:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.434559:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.434568:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:3.0:1788271793.434571:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271793.434575:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18000, rc 0) 00000100:00100000:3.0:1788271793.434641:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11545:x1875138574364288:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 353us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271793.434648:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 177 00000100:00100000:1.0:1788271793.442463:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.442677:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574364544 00000100:00100000:3.0:1788271793.442689:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574364544 00000100:00100000:3.0:1788271793.442787:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 178 00000100:00100000:3.0:1788271793.442798:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11545:x1875138574364544:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271793.442888:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.442906:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.442919:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271793.443253:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788271793.443265:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356624850525ns, next at 357624847852ns, rc = 0 00000004:00010000:3.0:1788271793.443347:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000160ca46a reply state 0000000053285333 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271793.443357:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271793.443486:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11545:x1875138574364544:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 689us (1029us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788271793.443494:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 178 00010000:00010000:2.0:1788271793.450793:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.450811:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.450817:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.450824:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271793.450829:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.450837:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.450853:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:2.0:1788271793.450857:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788271793.450861:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.450873:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7df5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271793.463839:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.465484:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574364672 00000100:00100000:2.0:1788271793.465497:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574364672 00000100:00100000:2.0:1788271793.465555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 179 00000100:00100000:2.0:1788271793.465565:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+25:11545:x1875138574364672:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271793.465588:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271793.465607:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b15 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.465664:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.465678:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.465697:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:2.0:1788271793.465700:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271793.465703:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271793.465761:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11545:x1875138574364672:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 197us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271793.465767:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 179 00000100:00100000:3.0:1788271793.469979:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.470019:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574364800 00000100:00100000:3.0:1788271793.470029:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574364800 00000100:00100000:3.0:1788271793.470109:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:3.0:1788271793.470119:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574364800:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788271793.470484:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574364800:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 365us (512us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788271793.470492:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00080000:3.0:1788271793.470516:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271793.474537:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.476823:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574365056 00000100:00100000:3.0:1788271793.476843:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574365056 00000100:00100000:3.0:1788271793.476906:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:3.0:1788271793.476917:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11545:x1875138574365056:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271793.477163:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11545:x1875138574365056:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 247us (2633us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788271793.477172:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:3.0:1788271793.482620:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.482968:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574365312 00000100:00100000:2.0:1788271793.482978:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574365312 00000100:00100000:2.0:1788271793.483050:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 180 00000100:00100000:2.0:1788271793.483076:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11545:x1875138574365312:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271793.483191:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11545:x1875138574365312:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 117us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271793.483199:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 180 00000040:00080000:1.0:1788271793.486285:0:12510:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271793.486292:0:12510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271793.486338:0:12510:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788271793.486350:0:12510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271793.486402:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.487314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574365440 00000100:00100000:2.0:1788271793.487326:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574365440 00000100:00100000:2.0:1788271793.487392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 181 00000100:00100000:2.0:1788271793.487404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c5763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11545:x1875138574365440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271793.487441:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271793.487464:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.487532:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.487546:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.487560:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271793.487597:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271793.487615:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.487641:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b1c expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.487658:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b1c expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.487677:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:2.0:1788271793.487680:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271793.487683:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ba00, rc 0) 00000100:00100000:2.0:1788271793.487746:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c5763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11545:x1875138574365440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 344us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271793.487753:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 181 00000100:00100000:3.0:1788271793.491288:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271793.491971:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574365568 00000100:00100000:1.0:1788271793.491983:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574365568 00000100:00100000:1.0:1788271793.492087:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:1.0:1788271793.492098:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574365568:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271793.492116:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271793.492139:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b23 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271793.492168:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dcb0, blocks: 0x1 00010000:00010000:1.0:1788271793.492190:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1788271793.492195:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271793.492205:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.492224:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.492240:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6200, rc 0) 00000100:00100000:1.0:1788271793.492309:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574365568:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 212us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271793.492318:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:3.0:1788271793.498869:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271793.498914:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574365824 00000100:00100000:0.0:1788271793.498924:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574365824 00000100:00100000:0.0:1788271793.499206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 182 00000100:00100000:0.0:1788271793.499215:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11545:x1875138574365824:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788271793.500243:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11545:x1875138574365824:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 1023us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271793.500567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 182 00000100:00100000:0.0:1788271793.511138:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.511181:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574365952 00000100:00100000:3.0:1788271793.511190:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574365952 00000100:00100000:3.0:1788271793.511236:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:3.0:1788271793.511245:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:11545:x1875138574365952:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271793.511267:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271793.511283:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b2a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.511309:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.511316:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271793.511321:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271793.511326:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.511362:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.511381:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 9 pid: 6698 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271793.511393:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff9c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586941056:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271793.511502:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff264d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271793.516006:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff9c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586941056:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271793.516050:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.516072:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19000, rc 0) 00000100:00100000:3.0:1788271793.516119:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:11545:x1875138574365952:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 4876us (4990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271793.516126:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:3.0:1788271793.516537:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.516631:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574366080 00000100:00100000:2.0:1788271793.516639:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574366080 00010000:00010000:2.0:1788271793.516671:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 9 pid: 6698 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.516715:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:2.0:1788271793.516725:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574366080:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271793.516739:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271793.516760:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 9 pid: 6698 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.516775:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 9 pid: 6698 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.516796:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b394bb3/0xbeb05ca97b5f7e11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b23 expref: 9 pid: 6698 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.516807:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271793.516819:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271793.516826:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.516836:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.516869:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.516883:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875138586941184:192.168.201.1@tcp:105: 00000100:00100000:2.0:1788271793.516954:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271793.521851:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875138586941184:192.168.201.1@tcp:105: 00010000:00010000:2.0:1788271793.521879:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271793.521941:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574366080:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 5217us (5404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271793.521952:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:2.0:1788271793.527177:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.527220:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574366208 00000100:00100000:3.0:1788271793.527229:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574366208 00002000:00100000:3.0:1788271793.527277:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ab6f7cf0e00 x1875138574366208/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:699/0 lens 504/0 e 0 to 0 dl 1788271804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271793.527286:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6f7cf0e00 with x1875138574366208 ext(0->8) 00002000:00010000:3.0:1788271793.527291:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6f7cf0e00 00000100:00100000:3.0:1788271793.527318:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1788271793.527328:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574366208:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788271793.527811:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:2353:x1875138574366208:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 482us (641us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788271793.527825:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00002000:00100000:3.0:1788271793.527833:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ab6f7cf0e00 x1875138574366208/t4294967314(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:699/0 lens 504/448 e 0 to 0 dl 1788271804 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271793.527842:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6f7cf0e00 with x1875138574366208 ext(0->8) 00002000:00010000:3.0:1788271793.527846:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6f7cf0e00 00000100:00100000:3.0:1788271793.532656:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.532772:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574366336 00000100:00100000:2.0:1788271793.532782:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574366336 00000100:00100000:2.0:1788271793.532843:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 183 00000100:00100000:2.0:1788271793.532856:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11545:x1875138574366336:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788271793.591079:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11545:x1875138574366336:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 58218us (58423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271793.591093:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 183 00000001:00080000:3.0:1788271793.591140:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:3.0:1788271793.591161:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:3.0:1788271793.591174:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1788271793.591188:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788271793.591197:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788271793.591216:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788271793.591226:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788271793.591351:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff9c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586941312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788271793.591433:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271793.591507:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586941312 00000100:00100000:3.0:1788271793.591515:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586941312 00000100:00100000:3.0:1788271793.591569:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788271793.591579:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586941312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788271793.591727:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788271793.591731:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788271792 00002000:00010000:3.0:1788271793.591733:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788271793.591743:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788271792 -> 1788271792 00002000:00010000:3.0:1788271793.591746:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788271793.591781:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586941312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (370us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788271793.591788:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788271793.591808:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788271793.591840:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6ff9c1500/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788271793.591846:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff9c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586941312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788271793.608895:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271793.609714:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574366464 00000100:00100000:0.0:1788271793.609725:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574366464 00000100:00100000:0.0:1788271793.609798:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:0.0:1788271793.609810:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:2353:x1875138574366464:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788271793.652086:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1788271793.652099:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1788271793.652336:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574366464:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 42522us (43443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271793.652349:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:2.0:1788271793.657058:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271793.657290:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574366720 00000100:00100000:0.0:1788271793.657300:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574366720 00000100:00100000:0.0:1788271793.657359:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 184 00000100:00100000:0.0:1788271793.657370:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:11545:x1875138574366720:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788271793.657453:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271793.657481:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b1c expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.657519:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:0.0:1788271793.657524:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271793.657555:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.657568:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.657578:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271793.657834:0:8302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ef3f97f reply state 00000000732539cf transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271793.657846:0:8302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271793.658007:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11545:x1875138574366720:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 638us (957us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788271793.658014:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 184 00010000:00010000:2.0:1788271793.660775:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.660803:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.660811:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.660816:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271793.660821:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.660828:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.660845:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:2.0:1788271793.660848:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271793.660852:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.660857:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7e1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.666806:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.666890:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574366848 00000100:00100000:3.0:1788271793.666899:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574366848 00000100:00100000:3.0:1788271793.666959:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:3.0:1788271793.666970:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574366848:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788271793.667218:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788271793.667222:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788271792 -> 1788271791 00002000:00010000:3.0:1788271793.667225:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788271789 00002000:00010000:3.0:1788271793.667227:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788271792 -> 1788271791 00002000:00010000:3.0:1788271793.667230:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788271793.667289:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574366848:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 320us (614us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788271793.667297:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:3.0:1788271793.670125:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271793.670218:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574367104 00000100:00100000:1.0:1788271793.670228:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574367104 00000100:00100000:1.0:1788271793.670992:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 185 00000100:00100000:1.0:1788271793.671005:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:11545:x1875138574367104:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788271793.671095:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.671113:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.671122:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.671160:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.671174:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271793.671187:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3260700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586941440:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271793.671286:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271793.675883:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.675962:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574367232 00000100:00100000:2.0:1788271793.675971:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574367232 00010000:00010000:2.0:1788271793.676006:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.676150:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:2.0:1788271793.676161:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:2354:x1875138574367232:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271793.676176:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271793.676197:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.676212:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.676233:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:2.0:1788271793.676237:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.676247:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.676254:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.676270:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271793.676312:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b0e expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271793.676334:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3260700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586941440:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271793.676354:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.676365:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.676371:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.676406:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.677173:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+18:2354:x1875138574367232:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1011us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271793.677182:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00010000:00010000:1.0:1788271793.677375:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.677384:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.677389:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271793.677394:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.677400:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.677430:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:1.0:1788271793.677434:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788271793.677438:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.677444:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f7e26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271793.677494:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+17:11545:x1875138574367104:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 6492us (7377us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788271793.677502:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 185 00000100:00100000:0.0:1788271793.681807:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271793.682304:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574367360 00000100:00100000:1.0:1788271793.682315:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574367360 00000100:00100000:1.0:1788271793.682373:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:1.0:1788271793.682392:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574367360:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788271793.682464:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.682486:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.682493:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271793.682497:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271793.682500:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.682529:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.682539:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 8 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271793.682550:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3260700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586941568:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271793.682631:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271793.686599:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3260700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586941568:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271793.686630:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271793.689114:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.689257:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574367488 00000100:00100000:3.0:1788271793.689267:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574367488 00010000:00010000:3.0:1788271793.689316:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271793.689360:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:3.0:1788271793.689370:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574367488:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271793.689405:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271793.689639:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.689657:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.689741:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edd92a3c/0xbeb05ca97b5f7e18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b2a expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.689759:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271793.689763:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271793.689769:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.689780:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.689833:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271793.689886:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574367488:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 517us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271793.689895:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00010000:00010000:1.0:1788271793.689899:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.689913:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.690126:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.690135:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.690143:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.690150:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271793.690155:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.690164:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.690176:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.690183:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2e0efc/0xbeb05ca97b5f7e2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271793.690232:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574367360:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 7839us (8433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271793.690242:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:1.0:1788271793.694219:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271793.694281:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574367744 00000100:00100000:3.0:1788271793.694291:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574367744 00000100:00100000:3.0:1788271793.694349:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 186 00000100:00100000:3.0:1788271793.694359:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+17:11545:x1875138574367744:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788271793.694794:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.694812:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.694824:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.695195:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.695209:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.695218:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.695253:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.695284:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.695300:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586941696:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271793.695843:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c50e46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271793.699367:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271793.699627:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574367872 00000100:00100000:1.0:1788271793.699638:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574367872 00010000:00010000:1.0:1788271793.699685:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271793.699758:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:1.0:1788271793.699768:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:2354:x1875138574367872:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271793.699783:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271793.699790:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.699803:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.699823:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:1.0:1788271793.699828:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.699837:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.699844:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271793.699859:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271793.699908:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:2354:x1875138574367872:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 142us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271793.699915:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 72 00010000:00010000:2.0:1788271793.700294:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7dfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b15 expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.700312:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586941696:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271793.700329:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.700338:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.700344:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271793.700787:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788271793.700917:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788271793.700960:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788271793.701108:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586941824:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788271793.701199:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271793.701279:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271793.701803:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586941824 00000100:00100000:0.0:1788271793.701810:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586941824 00000100:00100000:0.0:1788271793.701941:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271793.701950:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875138586941824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788271793.702050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875138586941824:12345-0@lo:1000:mdt00_002.0 Request processed in 101us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271793.702057:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271793.702124:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788271793.702130:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6ff9c1500, transno 4294967315 00000100:00100000:2.0:1788271793.702150:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586941824:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788271793.702668:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788271793.702931:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586941952:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788271793.702993:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271793.703593:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271793.704090:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586941952 00000100:00100000:3.0:1788271793.704098:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586941952 00000100:00100000:1.0:1788271793.704274:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271793.704284:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5839:x1875138586941952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788271793.704737:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5839:x1875138586941952:12345-0@lo:1000:mdt00_002.0 Request processed in 387us (1676us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788271793.704747:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271793.704836:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586941952:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788271793.704875:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704885:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704892:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704898:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ae00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271793.704903:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704910:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704926:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c3e3c700) 00010000:00010000:2.0:1788271793.704929:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271793.704932:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704937:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f7e3b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704966:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704984:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704990:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.704995:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271793.704998:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705004:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705012:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c4f64c00) 00010000:00010000:2.0:1788271793.705014:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271793.705017:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705022:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7d77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705057:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705071:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 21 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705080:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705112:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 21 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.705133:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 21 pid: 8302 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271793.705148:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586942080:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271793.705229:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271793.709665:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.709810:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586942080:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271793.709837:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271793.709975:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574368000 00000100:00100000:3.0:1788271793.709982:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574368000 00010000:00010000:3.0:1788271793.710019:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 22 pid: 8302 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271793.710062:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:3.0:1788271793.710073:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:2353:x1875138574368000:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271793.710087:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271793.710106:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 22 pid: 8302 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.710118:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 22 pid: 8302 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.710139:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023af9 expref: 22 pid: 8302 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.710154:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c4f64c00) 00010000:00010000:3.0:1788271793.710158:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.710167:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.710175:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.710201:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271793.710259:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:2353:x1875138574368000:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 187us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271793.710267:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 73 00010000:00010000:0.0:1788271793.710342:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710349:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710362:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710368:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710383:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710389:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271793.710393:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710400:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710409:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c4f64c00) 00010000:00010000:0.0:1788271793.710587:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271793.710592:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710599:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7e42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710610:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710626:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710633:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710638:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271793.710640:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710646:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710654:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c4f64c00) 00010000:00010000:0.0:1788271793.710656:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271793.710659:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271793.710664:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271793.710984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11545:x1875138574367744:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 16625us (16774us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788271793.710993:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 186 00000020:00080000:0.0:1788271793.710997:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788271793.713039:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271793.713048:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271793.713852:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788271793.713868:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271793.716489:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271793.716779:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574368256 00000100:00100000:2.0:1788271793.716790:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574368256 00000100:00100000:2.0:1788271793.716838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:2.0:1788271793.716848:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11545:x1875138574368256:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788271793.718152:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788271793.718263:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788271793.718316:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.718331:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.718343:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.718359:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.718365:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.719266:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.719343:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788271793.719492:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11545:x1875138574368256:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 2641us (3019us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788271793.719501:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00000020:00080000:2.0:1788271793.719507:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788271793.722078:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271793.722092:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.722102:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271793.722106:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.722132:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.722149:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab6c4f64900) 00010000:00010000:3.0:1788271793.722152:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788271793.722157:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271793.722163:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7e49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271793.722289:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271793.722291:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271793.722293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271794.162631:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271794.162941:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586942464:0@lo:400:kworker.0 00000100:00100000:2.0:1788271794.163049:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271794.163158:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788271794.163165:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586942336:0@lo:400:kworker.0 00000100:00100000:2.0:1788271794.163188:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271794.163205:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586942848:0@lo:400:kworker.0 00000100:00100000:2.0:1788271794.163231:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.163318:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586942848 00000100:00100000:1.0:1788271794.163326:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586942848 00000100:00100000:1.0:1788271794.163387:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788271794.163397:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586942848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.163476:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586942848:12345-0@lo:400:kworker.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.163484:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788271794.163526:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586942848:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.163550:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586942464 00000100:00100000:1.0:1788271794.163554:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586942464 00000100:00100000:1.0:1788271794.163578:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788271794.163584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586942464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.163618:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586942464:12345-0@lo:400:kworker.0 Request processed in 34us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.163624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788271794.163634:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586942336 00000100:00100000:1.0:1788271794.163637:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586942336 00000100:00100000:1.0:1788271794.163653:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788271794.163658:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586942336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.163683:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586942336:12345-0@lo:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.163699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788271794.163725:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586942336:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.163734:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586942464:0@lo:400:kworker.0 00000100:00080000:2.0:1788271794.165501:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271794.165510:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271794.166038:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586942208:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.166084:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586942976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271794.166137:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.166214:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586942592:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.166242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.166275:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586942592 00000100:00100000:1.0:1788271794.166281:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586942592 00000100:00100000:1.0:1788271794.166320:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271794.166329:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586942592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.166372:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586942592:12345-0@lo:400:kworker.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.166379:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271794.166400:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586943104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271794.166444:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.166480:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586942592:0@lo:400:kworker.0 00000100:00100000:2.0:1788271794.166498:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586942976 00000100:00100000:2.0:1788271794.166501:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586942976 00000100:00100000:2.0:1788271794.166544:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586943104 00000100:00100000:2.0:1788271794.166548:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586943104 00000100:00100000:3.0:1788271794.166705:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271794.166730:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586942720:0@lo:400:kworker.0 00000100:00100000:2.0:1788271794.166824:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788271794.166838:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586942976:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271794.166844:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271794.166851:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586943104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271794.166875:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271794.166911:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.166911:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586943104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.166917:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788271794.166942:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586942208 00000100:00100000:3.0:1788271794.166946:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586942208 00000100:00100000:1.0:1788271794.166954:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586943104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271794.166966:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788271794.166972:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586942208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.166991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586942720 00000100:00100000:1.0:1788271794.166995:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586942720 00000100:00100000:3.0:1788271794.167004:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586942208:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271794.167010:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788271794.167038:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788271794.167044:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586942720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.167074:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586942720:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.167080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788271794.167095:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:2.0:1788271794.167312:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788271794.167356:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586942976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 524us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271794.167482:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788271794.167538:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586942208:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.167552:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586942720:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.170528:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586942976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788271795.188164:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271795.472505:0:12564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271795.472521:0:12564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271795.474149:0:12564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788271795.474159:0:12564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271795.662864:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271795.663060:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574368512 00000100:00100000:0.0:1788271795.663071:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574368512 00000100:00100000:0.0:1788271795.663148:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 187 00000100:00100000:0.0:1788271795.663159:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:11564:x1875138574368512:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271795.663192:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271795.663214:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b31 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.663484:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7e57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.663498:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.663510:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271795.663521:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000100:00080000:1.0:1788271795.663980:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271795.664219:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b31 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.664235:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7e57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b31 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.664243:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:0.0:1788271795.664246:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788271795.664249:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375000, rc 0) 00000100:00100000:0.0:1788271795.664311:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11564:x1875138574368512:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1154us (1612us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788271795.664318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 187 00000100:00100000:0.0:1788271795.676985:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271795.677202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574368640 00000100:00100000:1.0:1788271795.677211:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574368640 00000100:00100000:1.0:1788271795.677262:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 188 00000100:00100000:1.0:1788271795.677272:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11564:x1875138574368640:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1788271795.677625:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.677725:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.677738:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.677755:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.677763:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.677778:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680856:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680877:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680890:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271795.680943:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680957:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680963:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680969:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680975:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271795.680980:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.680987:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681010:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271795.681021:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271795.681027:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681034:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f7e65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681047:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681051:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681057:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681061:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271795.681064:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681074:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681082:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6cb419c00) 00010000:00010000:1.0:1788271795.681085:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271795.681087:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681093:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f7e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681106:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681118:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681123:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681128:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271795.681131:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681137:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681145:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6cb419800) 00010000:00010000:1.0:1788271795.681147:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271795.681150:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.681155:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f7e73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271795.681251:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11564:x1875138574368640:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 3976us (4272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271795.681262:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 188 00000100:00100000:0.0:1788271795.810581:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271795.811492:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574368896 00000100:00100000:3.0:1788271795.811504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574368896 00000100:00100000:3.0:1788271795.811565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 189 00000100:00100000:3.0:1788271795.811576:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11567:x1875138574368896:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271795.811598:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271795.811620:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7e7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b38 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.811704:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.811721:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.811733:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.811749:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.811757:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.811763:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812112:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812132:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812141:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271795.812150:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788271795.812247:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812255:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812261:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812267:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271795.812272:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812279:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812292:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271795.812296:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271795.812301:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812307:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812319:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812330:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812352:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812358:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271795.812362:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812369:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812377:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271795.812379:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271795.812382:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812387:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812500:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7e7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812516:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.812523:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271795.812526:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271795.812534:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18000, rc 0) 00000100:00100000:3.0:1788271795.812596:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11567:x1875138574368896:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1021us (2023us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788271795.812604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 189 00000100:00100000:0.0:1788271795.817311:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271795.817500:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574369024 00000100:00100000:3.0:1788271795.817511:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574369024 00000100:00100000:3.0:1788271795.817574:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 190 00000100:00100000:3.0:1788271795.817584:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11567:x1875138574369024:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1788271795.817655:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817672:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817684:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817709:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817716:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817723:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817730:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271795.817735:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817743:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817763:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271795.817766:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271795.817771:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.817777:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271795.817848:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11567:x1875138574369024:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 265us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271795.817857:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 190 00000100:00100000:1.0:1788271795.825174:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271795.825247:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574369280 00000100:00100000:2.0:1788271795.825255:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574369280 00000100:00100000:2.0:1788271795.825301:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:2.0:1788271795.825308:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11567:x1875138574369280:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271795.825558:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11567:x1875138574369280:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 249us (394us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788271795.825566:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:0.0:1788271795.901372:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271795.901719:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574369536 00000100:00100000:3.0:1788271795.901729:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574369536 00000100:00100000:3.0:1788271795.901789:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 191 00000100:00100000:3.0:1788271795.901800:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11092:x1875138574369536:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271795.901822:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271795.901840:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ea4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b3f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.901929:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.901941:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.901949:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.901979:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.902015:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 28 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271795.902028:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586943232:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271795.902121:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271795.918483:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271795.918844:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586943232:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271795.918877:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271795.920049:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574369664 00000100:00100000:2.0:1788271795.920058:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574369664 00010000:00010000:2.0:1788271795.920103:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 29 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271795.920143:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:2.0:1788271795.920151:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:2354:x1875138574369664:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271795.920167:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271795.920174:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 29 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.920187:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 29 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.920219:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18000/0xbeb05ca97b5f7e8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b38 expref: 29 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.920233:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:2.0:1788271795.920237:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.920243:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.920248:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.920271:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271795.920318:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:2354:x1875138574369664:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 168us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271795.920324:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00010000:00010000:3.0:1788271795.920627:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.920636:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271795.920656:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788271795.920804:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ea4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.920818:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.920825:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271795.920828:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271795.920830:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19000, rc 0) 00000100:00100000:3.0:1788271795.920852:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11092:x1875138574369536:12345-192.168.201.1@tcp:101:bash.0 Request processed in 19054us (19492us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788271795.920868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 191 00000100:00100000:1.0:1788271795.935190:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271795.935275:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574369920 00000100:00100000:3.0:1788271795.935287:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574369920 00000100:00100000:3.0:1788271795.935344:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 192 00000100:00100000:3.0:1788271795.935355:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11092:x1875138574369920:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:3.0:1788271795.935668:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.935690:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271795.935704:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271795.935758:0:8302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788271795.935784:0:8302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f2038c reply state 00000000ef9ab2c4 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271795.935792:0:8302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788271795.935836:0:8302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788271795.935930:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11092:x1875138574369920:12345-192.168.201.1@tcp:36:bash.0 Request processed in 575us (749us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788271795.935937:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 192 00000020:00080000:3.0:1788271795.935942:0:8302:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788271795.940765:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.940785:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.940794:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.940801:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271795.940807:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.940835:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.940854:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:2.0:1788271795.940857:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271795.940862:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271795.940868:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19400/0xbeb05ca97b5f7eb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271795.941108:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271795.941258:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574370048 00000100:00100000:0.0:1788271795.941268:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574370048 00000100:00100000:0.0:1788271795.941317:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 193 00000100:00100000:0.0:1788271795.941326:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+31:11092:x1875138574370048:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1788271795.941350:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271795.941367:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7ec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.941470:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b46 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.941483:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b46 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271795.941503:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:0.0:1788271795.941506:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271795.941508:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374000, rc 0) 00000100:00100000:0.0:1788271795.941583:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11092:x1875138574370048:12345-192.168.201.1@tcp:101:bash.0 Request processed in 257us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271795.941590:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 193 00000100:00100000:0.0:1788271795.953713:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271795.953796:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574370176 00000100:00100000:1.0:1788271795.953805:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574370176 00000100:00100000:1.0:1788271795.953918:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:1.0:1788271795.953942:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:11092:x1875138574370176:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271795.953958:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271795.953977:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b4d expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271795.954009:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a96dcaf, atime: 0x6a96dcad, ctime: 0x6a96dcaf, blocks: 0xb 00010000:00010000:1.0:1788271795.954041:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1788271795.954046:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271795.954054:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.954069:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271795.954082:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7e00, rc 0) 00000100:00100000:1.0:1788271795.954135:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:11092:x1875138574370176:12345-192.168.201.1@tcp:101:bash.0 Request processed in 196us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271795.954142:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00080000:2.0:1788271795.955590:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271795.963949:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271795.964043:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574370304 00000100:00100000:3.0:1788271795.964052:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574370304 00002000:00010000:3.0:1788271795.964091:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788271795.964095:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6fef51180 with x1875138574370304 ext(0->18446744073709551615) 00002000:00010000:3.0:1788271795.964106:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6fef51180. 00000100:00100000:3.0:1788271795.964154:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:3.0:1788271795.964164:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2351:x1875138574370304:12345-192.168.201.1@tcp:10:bash.0 00002000:00010000:3.0:1788271795.964430:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788271795.964433:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788271791 -> 1788271795 00002000:00010000:3.0:1788271795.965098:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788271789 -> 1788271789 00002000:00010000:3.0:1788271795.965104:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788271791 -> 1788271795 00002000:00010000:3.0:1788271795.965107:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788271795.965178:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2351:x1875138574370304:12345-192.168.201.1@tcp:10:bash.0 Request processed in 1013us (1236us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788271795.965188:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00002000:00010000:3.0:1788271795.965193:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788271795.965196:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6fef51180 with x1875138574370304 ext(0->18446744073709551615) 00002000:00010000:3.0:1788271795.965203:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6fef51180. 00000100:00100000:0.0:1788271796.091335:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.091451:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574370432 00000100:00100000:3.0:1788271796.091462:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574370432 00000100:00100000:3.0:1788271796.091519:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 194 00000100:00100000:3.0:1788271796.091528:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11581:x1875138574370432:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:3.0:1788271796.091605:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091622:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091633:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091646:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091665:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091671:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091948:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091957:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.091963:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271796.092011:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092021:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092027:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092033:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092038:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271796.092042:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092049:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092065:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271796.092068:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271796.092073:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092080:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ece lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092093:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092098:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092103:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092107:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271796.092109:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092114:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092119:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271796.092121:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271796.092123:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092128:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092148:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092153:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092158:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092162:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271796.092165:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092170:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092177:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271796.092179:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271796.092181:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.092186:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7edc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.092251:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11581:x1875138574370432:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 721us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271796.092258:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 194 00000100:00100000:0.0:1788271796.158235:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.158329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574370688 00000100:00100000:3.0:1788271796.158348:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574370688 00000100:00100000:3.0:1788271796.158512:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 195 00000100:00100000:3.0:1788271796.158540:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11584:x1875138574370688:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271796.158562:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271796.158659:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b54 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.159974:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160007:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160021:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160043:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160051:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160058:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160700:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160718:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160788:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271796.160802:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788271796.160889:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160896:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160903:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160909:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271796.160913:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160920:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160931:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271796.160934:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271796.160938:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160944:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7eea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160957:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160970:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160976:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.160981:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271796.160999:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.161006:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.161014:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271796.161017:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271796.161019:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.161025:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.161083:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f7ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b54 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.161099:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b54 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.161107:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:2.0:1788271796.161109:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271796.161117:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b600, rc 0) 00000100:00100000:2.0:1788271796.161250:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:11584:x1875138574370688:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 2713us (3024us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788271796.161258:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 195 00000100:00100000:0.0:1788271796.170911:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.171371:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574370816 00000100:00100000:3.0:1788271796.171381:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574370816 00000100:00100000:3.0:1788271796.171485:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00100000:3.0:1788271796.171504:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:11584:x1875138574370816:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1788271796.171913:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.171931:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.171941:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.171978:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.172004:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 34 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.172021:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586943360:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271796.172123:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c551e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271796.175722:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.175917:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586943360:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271796.175964:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271796.176105:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574371072 00000100:00100000:2.0:1788271796.176112:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574371072 00000100:00100000:2.0:1788271796.176163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:2.0:1788271796.176172:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:5594:x1875138574371072:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788271796.176505:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:5594:x1875138574371072:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 332us (797us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788271796.176512:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:0.0:1788271796.179877:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.180398:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574371200 00000100:00100000:3.0:1788271796.180408:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574371200 00010000:00010000:3.0:1788271796.180491:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 36 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.180549:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:3.0:1788271796.180559:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:2354:x1875138574371200:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271796.180582:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271796.180589:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 36 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.180601:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 36 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.180622:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7eab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b3f expref: 36 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.180638:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271796.180643:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.180652:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.180660:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.180712:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271796.180766:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:2354:x1875138574371200:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 208us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271796.180773:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 75 00010000:00010000:1.0:1788271796.181043:0:8302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181052:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181082:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181089:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181106:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181112:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271796.181115:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181122:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181131:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:1.0:1788271796.181134:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271796.181138:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.181143:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f7f06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271796.181185:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:11584:x1875138574370816:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 9690us (10283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271796.181192:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00100000:0.0:1788271796.186006:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.186102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574371456 00000100:00100000:2.0:1788271796.186112:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574371456 00000100:00100000:2.0:1788271796.186169:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:2.0:1788271796.186181:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+34:11584:x1875138574371456:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271796.186492:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:11584:x1875138574371456:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 313us (504us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788271796.186500:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00010000:00010000:1.0:1788271796.211723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271796.328761:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.329126:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574371712 00000100:00100000:2.0:1788271796.329136:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574371712 00000100:00100000:2.0:1788271796.329193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00100000:2.0:1788271796.329203:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+35:11595:x1875138574371712:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:2.0:1788271796.329226:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271796.329247:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7f0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b5b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329343:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329357:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329368:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329383:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329390:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329397:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329731:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329740:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329748:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271796.329758:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788271796.329838:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329845:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329857:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329862:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271796.329865:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329872:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329899:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271796.329901:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271796.329905:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329910:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.329922:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330052:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330060:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330065:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271796.330068:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330084:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330091:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271796.330094:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271796.330097:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330102:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330154:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f7f0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b5b expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330166:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b5b expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.330172:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:2.0:1788271796.330174:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271796.330176:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271796.330362:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+37:11595:x1875138574371712:12345-192.168.201.1@tcp:101:cat.0 Request processed in 1159us (1609us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788271796.330371:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00100000:1.0:1788271796.340688:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.340901:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.341714:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574371840 00000100:00100000:2.0:1788271796.341726:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574371840 00002000:00100000:2.0:1788271796.341776:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff8ab5c3261880 x1875138574371840/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:702/0 lens 496/0 e 0 to 0 dl 1788271807 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271796.341787:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab5c3261880 with x1875138574371840 ext(0->7) 00002000:00010000:2.0:1788271796.341805:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab5c3261880 00000100:00100000:2.0:1788271796.341840:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1788271796.341849:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574371840:12345-192.168.201.1@tcp:4:bash.0 00000100:00100000:2.0:1788271796.343710:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:2354:x1875138574371840:12345-192.168.201.1@tcp:4:bash.0 Request processed in 1853us (2802us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788271796.343723:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00002000:00100000:2.0:1788271796.343735:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff8ab5c3261880 x1875138574371840/t4294967319(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:702/0 lens 496/448 e 0 to 0 dl 1788271807 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271796.343743:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab5c3261880 with x1875138574371840 ext(0->7) 00002000:00010000:2.0:1788271796.343747:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab5c3261880 00000100:00100000:3.0:1788271796.347315:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574371968 00000100:00100000:3.0:1788271796.347335:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574371968 00000100:00100000:3.0:1788271796.347398:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:3.0:1788271796.347408:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:2354:x1875138574371968:12345-192.168.201.1@tcp:16:kworker.0 00000100:00100000:0.0:1788271796.348162:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.348233:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574372224 00000100:00100000:2.0:1788271796.348238:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574372224 00000100:00100000:2.0:1788271796.348279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:2.0:1788271796.348289:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+37:11595:x1875138574372224:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:2.0:1788271796.348544:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:11595:x1875138574372224:12345-192.168.201.1@tcp:35:cat.0 Request processed in 256us (382us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788271796.348552:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:0.0:1788271796.385033:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.386609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574372480 00000100:00100000:3.0:1788271796.386622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574372480 00000100:00100000:3.0:1788271796.386698:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 198 00000100:00100000:3.0:1788271796.386710:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:11596:x1875138574372480:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:3.0:1788271796.386766:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788271796.386790:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f7f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b5b expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386814:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f7ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b54 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386826:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7ec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b46 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386837:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3cb00) 00010000:00010000:3.0:1788271796.386845:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271796.386864:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386905:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386915:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386937:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386943:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.386950:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.387211:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.387218:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.387225:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271796.388143:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788271796.388156:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359569742365ns, next at 360569738984ns, rc = 0 00010000:00010000:3.0:1788271796.388220:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388232:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388251:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388259:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388264:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388270:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388293:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271796.388314:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388321:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388704:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388710:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271796.388715:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388723:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388734:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271796.388737:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788271796.388749:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388755:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7f3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388773:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388780:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388785:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388790:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271796.388792:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388798:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388806:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271796.388809:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271796.388812:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.388818:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7f30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271796.388827:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007362fb22 reply state 00000000b5a2e405 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.388846:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271796.389620:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+37:11596:x1875138574372480:12345-192.168.201.1@tcp:36:rm.0 Request processed in 2907us (4590us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788271796.389629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 198 00010000:00010000:3.0:1788271796.389663:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271796.389670:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.389676:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271796.389680:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.389686:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.389695:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271796.389697:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788271796.389701:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.389706:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7f45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.389721:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271796.389723:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271796.389725:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271796.396075:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.396093:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.396115:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.396121:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271796.396127:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.396135:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.396152:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c3e3cd00) 00010000:00010000:3.0:1788271796.396155:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271796.396160:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.396167:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7f37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271796.416161:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788271796.416186:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000100:00100000:0.0:1788271796.416456:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2354:x1875138574371968:12345-192.168.201.1@tcp:16:kworker.0 Request processed in 69043us (75771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271796.416467:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:3.0:1788271796.517479:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271796.517584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574372736 00000100:00100000:0.0:1788271796.517593:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574372736 00000100:00100000:0.0:1788271796.517658:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 199 00000100:00100000:0.0:1788271796.517668:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+36:11602:x1875138574372736:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1788271796.517693:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271796.517717:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7f4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b62 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.517848:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.517865:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.517876:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.517894:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.517901:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.517941:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271796.518494:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788271796.518654:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518665:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518673:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518706:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518714:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518721:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518727:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271796.518731:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518739:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518751:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:0.0:1788271796.518754:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271796.518765:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518772:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374400/0xbeb05ca97b5f7f53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271796.518785:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6f5d58a reply state 0000000042dbdbd0 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271796.518794:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788271796.518824:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375e00/0xbeb05ca97b5f7f4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518837:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.518845:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271796.518848:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271796.518851:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374600, rc 0) 00000100:00100000:0.0:1788271796.518910:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:11602:x1875138574372736:12345-192.168.201.1@tcp:101:bash.0 Request processed in 1243us (1441us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788271796.518918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 199 00010000:00010000:2.0:1788271796.521349:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.521365:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.521373:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.521380:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271796.521395:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.521402:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.521455:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c2fd1c00) 00010000:00010000:2.0:1788271796.521459:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271796.521464:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.521471:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f7f5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.532871:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.535184:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574372864 00000100:00100000:2.0:1788271796.535200:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574372864 00000100:00100000:3.0:1788271796.540828:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:3.0:1788271796.540842:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2351:x1875138574372864:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271796.540860:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271796.540891:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b69 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271796.540922:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788271796.540942:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788271796.540958:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271796.540968:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.540996:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.541010:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18800, rc 0) 00000100:00100000:3.0:1788271796.541076:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2351:x1875138574372864:12345-192.168.201.1@tcp:101:bash.0 Request processed in 238us (8215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271796.541083:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:1.0:1788271796.551467:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271796.551642:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574372992 00000100:00100000:0.0:1788271796.551652:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574372992 00000100:00100000:0.0:1788271796.551697:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:0.0:1788271796.551706:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:11602:x1875138574372992:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1788271796.551723:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271796.551740:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b70 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.551790:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.551800:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271796.551804:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271796.551810:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.551844:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.551858:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 7 pid: 6700 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271796.551871:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fef52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875138586943488:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271796.551994:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d8000 going to sleep for 11 seconds 00000100:00080000:2.0:1788271796.553242:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271796.555442:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.555544:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574373120 00000100:00100000:2.0:1788271796.555553:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574373120 00010000:00010000:2.0:1788271796.555595:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 8 pid: 6700 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271796.555643:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:2.0:1788271796.555655:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574373120:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271796.555669:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271796.555691:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 8 pid: 6700 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.555705:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 8 pid: 6700 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.555745:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271796.555750:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271796.555758:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.555768:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.555803:0:8506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271796.555816:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1875138586943616:192.168.201.1@tcp:105: 00000100:00100000:2.0:1788271796.555897:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8840 going to sleep for 11 seconds 00010000:00010000:1.0:1788271796.556633:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000145dcc43/0xbeb05ca97b5f7f6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b69 expref: 8 pid: 6700 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271796.556668:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fef52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875138586943488:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271796.556695:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.556707:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375e00, rc 0) 00000100:00100000:1.0:1788271796.556745:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:11602:x1875138574372992:12345-192.168.201.1@tcp:101:bash.0 Request processed in 5038us (5286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271796.556753:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:2.0:1788271796.559802:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1875138586943616:192.168.201.1@tcp:105: 00010000:00010000:2.0:1788271796.559829:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271796.559959:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574373120:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 4305us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271796.559969:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:1.0:1788271796.575769:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.576071:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574373376 00000100:00100000:2.0:1788271796.576091:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574373376 00000100:00100000:2.0:1788271796.576169:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:2.0:1788271796.576180:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+38:11602:x1875138574373376:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:3.0:1788271796.577191:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:11602:x1875138574373376:12345-192.168.201.1@tcp:35:bash.0 Request processed in 1003us (1428us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788271796.577584:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000040:00080000:3.0:1788271796.786640:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271796.786650:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271796.786865:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788271796.786872:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788271796.806034:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:0.0:1788271796.839774:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.839863:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574373504 00000100:00100000:1.0:1788271796.839873:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574373504 00000100:00100000:1.0:1788271796.839943:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 200 00000100:00100000:1.0:1788271796.839954:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+39:11618:x1875138574373504:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271796.839989:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271796.840010:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b77 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.840075:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7f84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.840089:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.840104:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271796.840179:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788271796.840183:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271796.840205:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.840231:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f7f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b77 expref: 41 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.840248:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b77 expref: 40 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.840257:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271796.840260:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271796.840265:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6e00, rc 0) 00000100:00100000:1.0:1788271796.840347:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+40:11618:x1875138574373504:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 394us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271796.840355:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 200 00000100:00100000:1.0:1788271796.846674:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.846711:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.846741:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.846773:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.846802:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574373760 00000100:00100000:1.0:1788271796.846810:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574373760 00000100:00100000:1.0:1788271796.846851:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574373888 00000100:00100000:1.0:1788271796.846853:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574373888 00000100:00100000:1.0:1788271796.846870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:1.0:1788271796.846879:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574373760:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271796.846971:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574373760:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271796.846989:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:1.0:1788271796.847005:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:1.0:1788271796.847012:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574373888:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271796.847036:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2354:x1875138574373888:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271796.847042:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:3.0:1788271796.847178:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574373632 00000100:00100000:3.0:1788271796.847182:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574373632 00000100:00100000:3.0:1788271796.847216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 292 00000100:00100000:3.0:1788271796.847224:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574373632:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271796.847250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2354:x1875138574373632:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271796.847257:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 292 00000100:00100000:0.0:1788271796.847542:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574374016 00000100:00100000:0.0:1788271796.847546:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574374016 00000100:00100000:0.0:1788271796.847591:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 148 00000100:00100000:0.0:1788271796.847598:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574374016:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271796.847645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574374016:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 48us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271796.847660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 148 00000100:00080000:3.0:1788271796.847741:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271796.852611:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271796.852706:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574374272 00000100:00100000:0.0:1788271796.852715:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574374272 00000100:00100000:0.0:1788271796.852777:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 201 00000100:00100000:0.0:1788271796.852787:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+40:11618:x1875138574374272:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271796.852808:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271796.852826:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7f8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b7e expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.852930:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7f92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.852943:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.852955:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271796.852967:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788271796.853089:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f7f8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b7e expref: 43 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.853105:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b7e expref: 42 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.853113:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271796.853116:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271796.853120:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374e00, rc 0) 00000100:00100000:0.0:1788271796.853297:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:11618:x1875138574374272:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 510us (693us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788271796.853304:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 201 00000100:00100000:0.0:1788271796.863305:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271796.863353:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271796.863450:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574374528 00000100:00100000:2.0:1788271796.863470:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574374528 00000100:00100000:2.0:1788271796.863517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 202 00000100:00100000:2.0:1788271796.863527:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+42:11618:x1875138574374528:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271796.863553:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271796.863572:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b85 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.863664:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7fa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.863678:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.863690:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271796.863702:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:3.0:1788271796.863744:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574374656 00000100:00100000:3.0:1788271796.863758:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574374656 00010000:00010000:2.0:1788271796.863831:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b85 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.863854:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00010000:00010000:2.0:1788271796.863859:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b85 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.863872:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c2fd1f00) 00000100:00100000:3.0:1788271796.863874:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:2351:x1875138574374656:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271796.863879:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788271796.863888:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a400, rc 0) 00010000:00010000:3.0:1788271796.863899:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271796.863931:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f7f92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b7e expref: 45 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271796.863951:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+45:11618:x1875138574374528:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 423us (655us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788271796.863972:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 202 00010000:00010000:3.0:1788271796.863988:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:3.0:1788271796.863998:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271796.864053:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+43:2351:x1875138574374656:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 184us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271796.864062:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1788271796.872612:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.872758:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574374784 00000100:00100000:1.0:1788271796.872779:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574374784 00000100:00100000:3.0:1788271796.875661:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:3.0:1788271796.875697:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+6:2351:x1875138574374784:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:3.0:1788271796.875766:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.875793:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.875804:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788271796.875809:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271796.875815:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.875865:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.875906:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 6 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.875926:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875138586943744:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271796.876096:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015fccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271796.879993:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ff9c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875138586943744:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271796.880042:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271796.882567:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.882923:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574374912 00000100:00100000:3.0:1788271796.882942:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574374912 00002000:00100000:3.0:1788271796.883017:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ab6fef50700 x1875138574374912/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:702/0 lens 504/0 e 0 to 0 dl 1788271807 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271796.883030:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6fef50700 with x1875138574374912 ext(0->8) 00010000:00010000:3.0:1788271796.883043:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 7 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.883062:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 7 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271796.883071:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6fef50700 00000100:00100000:3.0:1788271796.883202:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1788271796.883216:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574374912:12345-192.168.201.1@tcp:4:lfs.0 00000100:00100000:3.0:1788271796.884020:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2353:x1875138574374912:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 794us (1454us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788271796.884034:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00002000:00100000:3.0:1788271796.884045:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ab6fef50700 x1875138574374912/t4294967308(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:702/0 lens 504/448 e 0 to 0 dl 1788271807 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271796.884055:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6fef50700 with x1875138574374912 ext(0->8) 00010000:00010000:3.0:1788271796.884065:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 9 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.884085:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 9 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271796.884094:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab6fef50700 00000100:00100000:0.0:1788271796.892147:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271796.892343:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574375040 00000100:00100000:1.0:1788271796.892357:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574375040 00010000:00010000:1.0:1788271796.892453:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 9 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271796.892511:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:1.0:1788271796.892536:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574375040:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271796.892558:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788271796.892586:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788271796.892589:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788271795 00002000:00010000:1.0:1788271796.892592:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788271796 00002000:00010000:1.0:1788271796.892594:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788271795 00010000:00010000:1.0:1788271796.892601:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 9 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.892641:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 9 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.892674:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f7f76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x769326461023b70 expref: 9 pid: 8463 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.892694:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271796.892699:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271796.892706:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.892716:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.892752:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271796.892829:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574375040:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 307us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271796.892837:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00010000:00010000:3.0:1788271796.893000:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893022:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893065:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893073:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893104:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893112:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271796.893116:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893124:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893143:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.893150:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000371c2ea/0xbeb05ca97b5f7fb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271796.893245:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2351:x1875138574374784:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 17563us (20648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271796.893257:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:2.0:1788271796.897778:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.897950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574375296 00000100:00100000:3.0:1788271796.897964:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574375296 00000100:00100000:3.0:1788271796.898053:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:3.0:1788271796.898066:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+43:11618:x1875138574375296:12345-192.168.201.1@tcp:35:lfs.0 00000004:00010000:3.0:1788271796.898153:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b85 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271796.901696:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788271796.901782:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788271796.902239:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788271796.902306:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.902332:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.902341:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.902398:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.902440:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 47 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271796.902460:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875138586943872:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271796.902581:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271796.910556:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875138586943872:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271796.910599:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271796.914944:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.915293:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574375424 00000100:00100000:3.0:1788271796.915307:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574375424 00010000:00010000:3.0:1788271796.915372:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271796.915646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:0.0:1788271796.915662:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+48:2353:x1875138574375424:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271796.915682:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271796.915691:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.915721:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.915750:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f7f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b62 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.915770:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:0.0:1788271796.915777:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.915788:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.915797:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271796.915853:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271796.915931:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edf4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+47:2353:x1875138574375424:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 274us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271796.915940:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 78 00010000:00010000:2.0:1788271796.916346:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271796.916357:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271796.916585:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788271796.916839:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788271796.917001:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fe9c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586944000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788271796.917073:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271796.917720:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271796.921823:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586944000 00000100:00100000:1.0:1788271796.921843:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586944000 00000100:00100000:1.0:1788271796.921955:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271796.921968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875138586944000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788271796.922153:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875138586944000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 187us (5078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271796.922161:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271796.922242:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788271796.922250:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6f745df80, transno 4294967307 00000100:00100000:1.0:1788271796.922270:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fe9c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586944000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788271796.922946:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788271796.923066:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586944128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788271796.923120:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271796.923163:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586944128 00000100:00100000:1.0:1788271796.923169:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586944128 00000100:00100000:1.0:1788271796.923205:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788271796.923214:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5840:x1875138586944128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788271796.923393:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5840:x1875138586944128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 179us (271us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788271796.923401:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788271796.923609:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271796.923637:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875138586944128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788271796.923695:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788271796.923744:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.923757:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.923766:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.923772:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ba00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271796.923778:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.923796:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.923817:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:1.0:1788271796.923820:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788271796.923825:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271796.923832:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f7fbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271796.924025:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788271796.924118:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788271796.924131:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360105717032ns, next at 361105714632ns, rc = 0 00000001:00080000:1.0:1788271796.924138:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788271796.924174:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c2fd1f00) 00010000:00010000:1.0:1788271796.924177:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788271796.924184:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f7fa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b85 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271796.924344:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:11618:x1875138574375296:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 26280us (26580us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788271796.924353:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000020:00080000:1.0:1788271796.924358:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788271796.926005:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271796.930044:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.930154:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574375552 00000100:00100000:3.0:1788271796.930168:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574375552 00000100:00100000:3.0:1788271796.930247:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 203 00000100:00100000:3.0:1788271796.930261:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+50:11618:x1875138574375552:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271796.930296:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271796.930339:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b8c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.930480:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b8c expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.930499:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b8c expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271796.930536:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:3.0:1788271796.930540:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271796.930545:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19600, rc 0) 00000100:00100000:3.0:1788271796.930624:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:11618:x1875138574375552:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 366us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271796.930632:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 203 00000100:00100000:1.0:1788271796.934500:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271796.934748:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574375808 00000100:00100000:3.0:1788271796.934759:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574375808 00000100:00100000:3.0:1788271796.934815:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:3.0:1788271796.934823:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+51:11618:x1875138574375808:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1788271796.935122:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:11618:x1875138574375808:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 298us (633us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788271796.935128:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:1.0:1788271797.023697:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.024697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574375936 00000100:00100000:2.0:1788271797.024710:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574375936 00000100:00100000:2.0:1788271797.024783:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 204 00000100:00100000:2.0:1788271797.024792:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:11628:x1875138574375936:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:2.0:1788271797.024879:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.024896:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.024906:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.024918:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.024923:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.024927:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025133:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025161:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025169:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788271797.025173:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788271797.025243:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025259:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025266:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025273:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025281:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271797.025286:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025294:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025305:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271797.025307:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271797.025312:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025317:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f7fca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025343:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025349:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025356:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025362:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271797.025365:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025371:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025377:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271797.025378:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271797.025380:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025384:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f7fd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025457:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025464:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025469:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025480:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271797.025483:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025489:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025498:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271797.025501:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271797.025504:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.025507:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f7fd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271797.025603:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:11628:x1875138574375936:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 810us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.025612:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 204 00000100:00100000:2.0:1788271797.071804:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.071909:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574376192 00000100:00100000:3.0:1788271797.071922:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574376192 00000100:00100000:3.0:1788271797.072010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 205 00000100:00100000:3.0:1788271797.072025:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+52:11631:x1875138574376192:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271797.072054:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271797.072084:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7fdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.072888:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.072911:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.072927:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.072950:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.072958:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.072996:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073176:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073186:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073207:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271797.073219:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788271797.073572:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073582:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073589:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073596:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271797.073601:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073609:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073623:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271797.073627:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271797.073640:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073647:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f7fe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073663:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073670:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073676:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073682:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271797.073685:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073691:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073699:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271797.073701:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271797.073704:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073710:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f7fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073770:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f7fdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073803:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.073812:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:3.0:1788271797.073814:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271797.073816:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18800, rc 0) 00000100:00100000:3.0:1788271797.073906:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:11631:x1875138574376192:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1884us (2118us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788271797.073916:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 205 00000100:00100000:1.0:1788271797.077872:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271797.077990:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574376320 00000100:00100000:0.0:1788271797.078003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574376320 00000100:00100000:0.0:1788271797.078081:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 206 00000100:00100000:0.0:1788271797.078094:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:11631:x1875138574376320:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:0.0:1788271797.078209:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078239:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078255:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078288:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078296:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078304:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078311:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271797.078652:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078685:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078700:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271797.078703:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271797.078708:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.078714:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f8002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271797.078927:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:11631:x1875138574376320:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 834us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271797.078937:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 206 00000100:00100000:1.0:1788271797.090042:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.090156:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574376576 00000100:00100000:3.0:1788271797.090170:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574376576 00000100:00100000:3.0:1788271797.090255:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:3.0:1788271797.090267:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:11631:x1875138574376576:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1788271797.090913:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:11631:x1875138574376576:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 646us (881us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788271797.090923:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:3.0:1788271797.179152:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.179349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574376832 00000100:00100000:1.0:1788271797.179361:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574376832 00000100:00100000:1.0:1788271797.179485:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:1.0:1788271797.179498:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ff9c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:11641:x1875138574376832:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271797.179534:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271797.179538:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271797.179576:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f7f84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b77 expref: 55 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.179598:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271797.179604:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271797.179620:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f8009 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023b9a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.179776:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.179788:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.179795:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.179828:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.179838:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 55 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.179861:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3262300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586944256:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271797.179992:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271797.186057:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3262300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875138586944256:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271797.186099:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271797.186823:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.186884:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574376960 00000100:00100000:1.0:1788271797.186892:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574376960 00010000:00010000:1.0:1788271797.186930:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 56 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.186983:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:1.0:1788271797.186995:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+56:2353:x1875138574376960:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271797.187014:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271797.187022:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 56 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.187034:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 56 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.187057:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f7ff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b93 expref: 56 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.187073:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:1.0:1788271797.187077:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.187093:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.187099:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.187124:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271797.187186:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:2353:x1875138574376960:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 193us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.187199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 79 00010000:00010000:3.0:1788271797.187437:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.187447:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271797.187473:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788271797.187643:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f8009 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.187667:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.187673:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:3.0:1788271797.187675:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271797.187677:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6800, rc 0) 00000100:00100000:3.0:1788271797.187700:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ff9c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:11641:x1875138574376832:12345-192.168.201.1@tcp:101:bash.0 Request processed in 8207us (8565us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788271797.187706:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:2.0:1788271797.193839:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.193924:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574377216 00000100:00100000:3.0:1788271797.193936:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574377216 00000100:00100000:3.0:1788271797.194020:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 208 00000100:00100000:3.0:1788271797.194033:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+55:11641:x1875138574377216:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:3.0:1788271797.194500:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.194522:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.194536:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271797.194602:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788271797.194629:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000309dd3eb reply state 000000002ff59161 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271797.194638:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271797.194766:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:11641:x1875138574377216:12345-192.168.201.1@tcp:36:bash.0 Request processed in 735us (938us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788271797.194775:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 208 00000020:00080000:3.0:1788271797.194781:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788271797.200065:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:3.0:1788271797.200068:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.200154:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.200166:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.200173:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574377344 00010000:00010000:3.0:1788271797.200174:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271797.200182:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.200187:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574377344 00010000:00010000:3.0:1788271797.200192:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.200216:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:3.0:1788271797.200219:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271797.200224:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.200231:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f801e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.200276:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 209 00000100:00100000:1.0:1788271797.200289:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:11641:x1875138574377344:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271797.200323:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271797.200347:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f8025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023ba1 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.200496:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.200509:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.200516:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.200554:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.200582:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 58 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.200596:0:8302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3262300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586944384:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271797.200684:0:8302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271797.205864:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.205957:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574377472 00000100:00100000:3.0:1788271797.205978:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574377472 00010000:00010000:3.0:1788271797.206463:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 59 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271797.206666:0:8302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3262300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8302:1875138586944384:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271797.206692:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271797.207057:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:3.0:1788271797.207070:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:2354:x1875138574377472:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271797.207099:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271797.207109:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 59 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.207123:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 59 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.207150:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8010 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023b9a expref: 59 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.207167:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:3.0:1788271797.207173:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.207183:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.207192:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.207225:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271797.207294:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:2354:x1875138574377472:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 227us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.207302:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00010000:00010000:1.0:1788271797.207529:0:8302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.207539:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271797.207601:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788271797.207607:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271797.207631:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.207662:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f8025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 58 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.207676:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 57 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.207682:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:1.0:1788271797.207684:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271797.207686:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7600, rc 0) 00000100:00100000:1.0:1788271797.207713:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:11641:x1875138574377344:12345-192.168.201.1@tcp:101:bash.0 Request processed in 7429us (7664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.207730:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 209 00000100:00100000:3.0:1788271797.213848:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.214341:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574377728 00000100:00100000:1.0:1788271797.214354:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574377728 00000100:00100000:1.0:1788271797.214475:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1788271797.214488:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+57:11641:x1875138574377728:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:1.0:1788271797.214821:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:11641:x1875138574377728:12345-192.168.201.1@tcp:35:bash.0 Request processed in 335us (989us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788271797.214830:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00010000:00010000:1.0:1788271797.234651:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271797.254658:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.254744:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574377856 00000100:00100000:3.0:1788271797.254756:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574377856 00000100:00100000:3.0:1788271797.254820:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 210 00000100:00100000:3.0:1788271797.254828:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+58:11647:x1875138574377856:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271797.254861:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271797.254883:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f8033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023ba8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.254961:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f803a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.254992:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f803a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.255005:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f803a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271797.255083:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788271797.255086:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271797.255106:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f803a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.255131:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f8033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ba8 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.255147:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f803a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ba8 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.255154:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271797.255156:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271797.255167:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18c00, rc 0) 00000100:00100000:3.0:1788271797.255231:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:11647:x1875138574377856:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 404us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.255236:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 210 00000100:00100000:3.0:1788271797.258856:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.258950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574377984 00000100:00100000:2.0:1788271797.258963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574377984 00000100:00100000:2.0:1788271797.259048:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:2.0:1788271797.259058:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:11647:x1875138574377984:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271797.259083:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271797.259107:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023baf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259205:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259233:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259250:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259269:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259277:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259284:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259465:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f8056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259476:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259484:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271797.259528:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788271797.259532:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271797.259551:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259570:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259577:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259582:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259587:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259592:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271797.259595:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259601:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259611:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:2.0:1788271797.259613:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271797.259616:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259620:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259630:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259635:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259642:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259645:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271797.259647:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259650:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259654:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271797.259656:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271797.259657:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259660:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f804f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259704:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023baf expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259713:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023baf expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.259717:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271797.259718:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271797.259720:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ae00, rc 0) 00000100:00100000:2.0:1788271797.259780:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11647:x1875138574377984:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 724us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.259793:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:2.0:1788271797.263143:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.263262:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.263444:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574378368 00000100:00100000:1.0:1788271797.263456:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574378368 00000100:00100000:1.0:1788271797.263536:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1788271797.263546:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c9e23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:2354:x1875138574378368:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271797.263562:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271797.263593:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f8056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023baf expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.263619:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:1.0:1788271797.263626:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271797.263692:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c9e23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:2354:x1875138574378368:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 147us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.263698:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:0.0:1788271797.266643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574378240 00000100:00100000:0.0:1788271797.266662:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574378240 00000100:00100000:0.0:1788271797.266744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 212 00000100:00100000:0.0:1788271797.266758:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:11647:x1875138574378240:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271797.266785:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271797.266814:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f805d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bb6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.266981:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.267000:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 60 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.267009:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.267055:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 60 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.267070:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 60 pid: 8302 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271797.267087:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6fef53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586944512:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271797.267392:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ca5753c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271797.287524:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271797.287671:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6fef53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586944512:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271797.287707:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271797.287839:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574378496 00000100:00100000:3.0:1788271797.287849:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574378496 00010000:00010000:3.0:1788271797.287896:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 61 pid: 8302 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271797.287943:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:3.0:1788271797.287953:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:2354:x1875138574378496:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271797.287998:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271797.288008:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 61 pid: 8302 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.288022:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 61 pid: 8302 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.288050:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f802c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023ba1 expref: 61 pid: 8302 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.288071:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:3.0:1788271797.288076:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.288086:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.288118:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.288197:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271797.288351:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:2354:x1875138574378496:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 398us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.288360:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 81 00010000:00010000:2.0:1788271797.291009:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.291030:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271797.291062:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788271797.291441:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f805d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.291466:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.291477:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271797.291480:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271797.291484:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374000, rc 0) 00000100:00100000:2.0:1788271797.291630:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11647:x1875138574378240:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 24873us (28496us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788271797.291640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 212 00000100:00100000:2.0:1788271797.297689:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.297811:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574378752 00000100:00100000:1.0:1788271797.297824:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574378752 00000100:00100000:1.0:1788271797.297905:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1788271797.297918:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11647:x1875138574378752:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:1.0:1788271797.297959:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271797.298001:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f7fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b8c expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.298025:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:1.0:1788271797.298031:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271797.298222:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:11647:x1875138574378752:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 305us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.298239:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1788271797.305758:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.305866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574378880 00000100:00100000:2.0:1788271797.305879:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574378880 00000100:00100000:2.0:1788271797.305946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:2.0:1788271797.305958:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:11647:x1875138574378880:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:2.0:1788271797.306122:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.306144:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.306157:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271797.306453:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788271797.306558:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:11647:x1875138574378880:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 602us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.306567:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:3.0:1788271797.315954:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.316162:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574379008 00000100:00100000:2.0:1788271797.316176:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574379008 00000100:00100000:2.0:1788271797.316323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 214 00000100:00100000:2.0:1788271797.316337:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+59:11647:x1875138574379008:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271797.316364:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271797.316391:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bbd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.316520:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.316533:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.316557:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.316606:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.316625:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271797.316628:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271797.316633:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.316642:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a800, rc 0) 00000100:00100000:2.0:1788271797.316719:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11647:x1875138574379008:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 385us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.316727:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 214 00000040:00080000:3.0:1788271797.811255:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271797.811270:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271797.811332:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788271797.811341:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271797.811686:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586944640:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271797.811846:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ccc5b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271797.826669:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271797.826888:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586944640:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788271797.830717:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574379136 00000100:00100000:2.0:1788271797.830740:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574379136 00000100:00100000:2.0:1788271797.830964:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:2.0:1788271797.830981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11648:x1875138574379136:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788271797.831031:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788271797.831198:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11648:x1875138574379136:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 221us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.831217:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:0.0:1788271797.835794:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.836195:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574379264 00000100:00100000:1.0:1788271797.836218:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574379264 00000100:00100000:1.0:1788271797.836295:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:1.0:1788271797.836308:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11648:x1875138574379264:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788271797.836404:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.836447:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.836588:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.836786:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.836821:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.836834:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.836881:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.836892:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837028:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271797.837078:0:8302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788271797.837083:0:8302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271797.837100:0:8302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837111:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837118:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837125:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837132:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271797.837137:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837145:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837157:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:1.0:1788271797.837168:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271797.837173:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837180:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f8080 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837197:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837203:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837209:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837214:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271797.837217:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837223:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837229:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271797.837231:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271797.837234:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837239:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f8087 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837252:0:8302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837261:0:8302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837268:0:8302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837272:0:8302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271797.837275:0:8302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837281:0:8302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837287:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:1.0:1788271797.837289:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271797.837292:0:8302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.837298:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f808e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.837402:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11648:x1875138574379264:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 1093us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.837456:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:0.0:1788271797.841832:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.842016:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574379520 00000100:00100000:2.0:1788271797.842030:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574379520 00000100:00100000:2.0:1788271797.842114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:2.0:1788271797.842127:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+60:11648:x1875138574379520:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271797.842284:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271797.842331:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8095 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bc4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842594:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842621:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842634:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271797.842649:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788271797.842784:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842791:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842799:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842806:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271797.842810:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842818:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842833:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271797.842836:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788271797.842842:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842848:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374e00/0xbeb05ca97b5f809c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842903:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8095 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bc4 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842923:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:0.0:1788271797.842925:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271797.842931:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8095 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bc4 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271797.842945:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a600, rc 0) 00000100:00100000:0.0:1788271797.843049:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:11648:x1875138574379520:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 923us (1231us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788271797.843057:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:0.0:1788271797.845970:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.846067:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574379648 00000100:00100000:2.0:1788271797.846081:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574379648 00000100:00100000:2.0:1788271797.846197:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:2.0:1788271797.846222:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:11648:x1875138574379648:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788271797.846272:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788271797.846437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:11648:x1875138574379648:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 205us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.846446:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:2.0:1788271797.865944:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.866082:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574379904 00000100:00100000:1.0:1788271797.866098:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574379904 00000100:00100000:1.0:1788271797.866184:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 219 00000100:00100000:1.0:1788271797.866195:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:11648:x1875138574379904:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271797.866217:0:8302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271797.866233:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271797.866261:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f803a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023ba8 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.866283:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271797.866288:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271797.866300:0:8302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f80aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bcb expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271797.867109:0:8302:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788271797.867319:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f80b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.867334:0:8302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.867345:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.867407:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7a00/0xbeb05ca97b5f80aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bcb expref: 63 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.867455:0:8302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f80b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bcb expref: 62 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.867597:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271797.867600:0:8302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271797.867603:0:8302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6600, rc 0) 00000100:00100000:1.0:1788271797.867675:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+62:11648:x1875138574379904:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1481us (1746us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788271797.867698:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 219 00000100:00100000:0.0:1788271797.871234:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.871396:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574380160 00000100:00100000:3.0:1788271797.871405:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574380160 00000100:00100000:3.0:1788271797.871691:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:3.0:1788271797.871702:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fef52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+62:11648:x1875138574380160:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271797.871756:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271797.871782:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f80b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bcb expref: 62 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.871865:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:3.0:1788271797.871876:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271797.871965:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.871992:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872001:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872017:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872023:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872029:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872103:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872110:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872270:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872278:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271797.872283:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872291:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872371:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:3.0:1788271797.872381:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271797.872386:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872392:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872404:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.872410:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.873660:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.873667:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271797.873671:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.873678:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.873693:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x52a580e3 (ffff8ab6c3e3ca00) 00010000:00010000:3.0:1788271797.873696:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271797.873699:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.873705:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x52a580e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271797.873984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fef52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:11648:x1875138574380160:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 2276us (2752us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271797.874007:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:0.0:1788271797.878723:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.878823:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574380288 00000100:00100000:2.0:1788271797.878833:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574380288 00000100:00100000:2.0:1788271797.878885:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 221 00000100:00100000:2.0:1788271797.878906:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+61:11648:x1875138574380288:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271797.878926:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271797.878951:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bd2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.878999:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.879011:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.879022:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.879140:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.879160:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.879168:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271797.879171:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271797.879174:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b600, rc 0) 00000100:00100000:2.0:1788271797.879238:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+62:11648:x1875138574380288:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 344us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.879245:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 221 00000100:00100000:0.0:1788271797.884179:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.884266:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574380544 00000100:00100000:2.0:1788271797.884276:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574380544 00000100:00100000:2.0:1788271797.884339:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:2.0:1788271797.884351:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+62:11648:x1875138574380544:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788271797.884455:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.884482:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.884494:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271797.884736:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788271797.884744:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361066330488ns, next at 362066328565ns, rc = 0 00000004:00010000:2.0:1788271797.884840:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037acc954 reply state 00000000f4312a10 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271797.884849:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271797.884939:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+64:11648:x1875138574380544:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 589us (769us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788271797.884946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:0.0:1788271797.889123:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:2.0:1788271797.889218:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.889231:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.889238:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.889245:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271797.889250:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.889257:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.889273:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271797.889277:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788271797.889281:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.889287:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f80db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271797.889755:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574380672 00000100:00100000:3.0:1788271797.889765:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574380672 00000100:00100000:3.0:1788271797.889834:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 223 00000100:00100000:3.0:1788271797.889847:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+63:11648:x1875138574380672:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271797.889870:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271797.889887:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bd9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.889953:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.889976:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.889994:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:3.0:1788271797.889996:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271797.889999:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19000, rc 0) 00000100:00100000:3.0:1788271797.890063:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+64:11648:x1875138574380672:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 218us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.890070:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 223 00000100:00100000:0.0:1788271797.894028:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.894124:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574380800 00000100:00100000:1.0:1788271797.894134:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574380800 00000100:00100000:1.0:1788271797.894206:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:1.0:1788271797.894217:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574380800:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788271797.894595:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574380800:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 379us (576us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788271797.894603:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00080000:3.0:1788271797.895141:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271797.899658:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.899835:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574381056 00000100:00100000:1.0:1788271797.899849:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574381056 00000100:00100000:1.0:1788271797.899932:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:1.0:1788271797.899944:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+64:11648:x1875138574381056:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788271797.900201:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+65:11648:x1875138574381056:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 258us (562us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788271797.900209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:0.0:1788271797.907391:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.907614:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574381312 00000100:00100000:2.0:1788271797.907646:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574381312 00000100:00100000:2.0:1788271797.907723:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:2.0:1788271797.907737:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+65:11648:x1875138574381312:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271797.907900:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+65:11648:x1875138574381312:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 165us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.907908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:0.0:1788271797.911124:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.911216:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574381440 00000100:00100000:3.0:1788271797.911229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574381440 00000100:00100000:3.0:1788271797.911312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 225 00000100:00100000:3.0:1788271797.911326:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+65:11648:x1875138574381440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271797.911375:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271797.911632:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023be0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.911724:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f80f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.911741:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f80f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.911754:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f80f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271797.911800:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271797.911821:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f80f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.911854:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f80e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023be0 expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.911876:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f80f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023be0 expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.912035:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:3.0:1788271797.912037:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788271797.912043:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18e00, rc 0) 00000100:00100000:3.0:1788271797.912167:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+66:11648:x1875138574381440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 843us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.912175:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 225 00000100:00100000:0.0:1788271797.916010:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.916299:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574381568 00000100:00100000:2.0:1788271797.916320:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574381568 00000100:00100000:2.0:1788271797.916394:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:2.0:1788271797.916407:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574381568:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271797.916477:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271797.916671:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023be7 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271797.916709:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dcb5, blocks: 0x1 00010000:00010000:2.0:1788271797.916735:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788271797.916740:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271797.916751:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 9 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.916775:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 9 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.916791:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024be00, rc 0) 00000100:00100000:2.0:1788271797.916868:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2353:x1875138574381568:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 464us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.917401:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:0.0:1788271797.920135:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.920265:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574381824 00000100:00100000:2.0:1788271797.920278:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574381824 00000100:00100000:2.0:1788271797.920361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:2.0:1788271797.920374:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+66:11648:x1875138574381824:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271797.920805:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+66:11648:x1875138574381824:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 432us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.920814:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:0.0:1788271797.928736:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271797.928836:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574381952 00000100:00100000:1.0:1788271797.928849:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574381952 00000100:00100000:1.0:1788271797.929039:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:1.0:1788271797.929053:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:11648:x1875138574381952:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271797.929079:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271797.929107:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bee expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.929149:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 10 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.929186:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271797.929191:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271797.929199:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.929244:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 10 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271797.929260:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 10 pid: 8463 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271797.929278:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586944768:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271797.929660:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6185d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271797.934007:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.934125:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574382080 00000100:00100000:2.0:1788271797.934138:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574382080 00010000:00010000:2.0:1788271797.934194:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 11 pid: 8463 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271797.934246:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:2.0:1788271797.934258:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:2353:x1875138574382080:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271797.934277:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271797.934320:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 11 pid: 8463 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.934339:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 11 pid: 8463 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.934370:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271797.934375:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271797.934385:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.934439:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271797.934490:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271797.934519:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875138586944896:192.168.201.1@tcp:105: 00000100:00100000:2.0:1788271797.934619:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f86c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788271797.937126:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f80f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023be7 expref: 11 pid: 8463 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271797.937159:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f745df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1875138586944768:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271797.937201:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271797.937219:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7a00, rc 0) 00000100:00100000:3.0:1788271797.937320:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:11648:x1875138574381952:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 8270us (8597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.937332:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:3.0:1788271797.940763:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875138586944896:192.168.201.1@tcp:105: 00010000:00010000:3.0:1788271797.940801:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271797.940893:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2353:x1875138574382080:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 6627us (6891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.940906:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:0.0:1788271797.941186:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271797.941774:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574382208 00000100:00100000:3.0:1788271797.941784:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574382208 00002000:00100000:3.0:1788271797.941838:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8ab6f7b2a300 x1875138574382208/t0(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:703/0 lens 504/0 e 0 to 0 dl 1788271808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271797.941850:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6f7b2a300 with x1875138574382208 ext(0->12) 00002000:00010000:3.0:1788271797.941856:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6f7b2a300 00000100:00100000:3.0:1788271797.941906:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:3.0:1788271797.941917:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574382208:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788271797.942676:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:2354:x1875138574382208:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 758us (1489us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788271797.942691:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00002000:00100000:3.0:1788271797.942700:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8ab6f7b2a300 x1875138574382208/t4294967321(0) o4->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:703/0 lens 504/448 e 0 to 0 dl 1788271808 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271797.942708:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6f7b2a300 with x1875138574382208 ext(0->12) 00002000:00010000:3.0:1788271797.942713:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6f7b2a300 00000100:00100000:1.0:1788271797.946816:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271797.947002:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574382336 00000100:00100000:2.0:1788271797.947015:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574382336 00000100:00100000:2.0:1788271797.947119:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 227 00000100:00100000:2.0:1788271797.947131:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f745df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+66:11648:x1875138574382336:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788271798.014480:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:3.0:1788271798.014517:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788271798.014537:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788271798.014560:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab6c6185f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788271798.014566:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6ccdf1900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6c6185900 00000020:00080000:3.0:1788271798.014569:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6ccdf1200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6edc92c00 00000004:00080000:3.0:1788271798.014586:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:1.0:1788271798.014977:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271798.015004:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586945024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788271798.015095:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271798.015498:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f745df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+54:11648:x1875138574382336:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 68364us (68692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271798.015511:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 227 00000100:00100000:1.0:1788271798.015651:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586945024 00000100:00100000:1.0:1788271798.015660:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586945024 00000100:00100000:1.0:1788271798.015722:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788271798.015732:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586945024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788271798.015765:0:8463:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1788271798.015809:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a96dcb3, atime: 0x6a96dcb4, ctime: 0x6a96dcb3, blocks: 0x1 00010000:00010000:1.0:1788271798.015819:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.015858:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1788271798.015862:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271798.015870:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.015903:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.015916:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.015924:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.015944:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788271798.017257:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab7015f83c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788271798.017270:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6edd0e300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab7015f8300 00000020:00080000:3.0:1788271798.017274:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6edd0e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6c500a400 00000004:00080000:3.0:1788271798.017317:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788271798.017355:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1788271798.017870:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1875138586945024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2133us (2770us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788271798.017889:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1788271798.017934:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271798.017943:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.017968:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271798.017973:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.018002:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.018029:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.018037:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b394bb3/0xbeb05ca97b5f8105 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.018059:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271798.018061:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271798.018063:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788271798.018226:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:2.0:1788271798.018700:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788271798.019917:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6edf4d500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788271798.019936:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586945024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788271798.020139:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586945280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788271798.021732:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271798.021840:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586945280 00000100:00100000:2.0:1788271798.021851:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586945280 00000100:00100000:2.0:1788271798.021931:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788271798.021944:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586945280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788271798.022228:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788271798.022232:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788271797 00002000:00010000:2.0:1788271798.022255:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788271798.022257:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788271797 -> 1788271797 00002000:00010000:2.0:1788271798.022260:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788271798.022324:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1875138586945280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 383us (598us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788271798.022332:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788271798.022387:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271798.022942:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586945152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788271798.023004:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271798.023085:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586945152 00000100:00100000:2.0:1788271798.023091:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586945152 00000100:00100000:2.0:1788271798.023132:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788271798.023141:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586945152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788271798.023176:0:8463:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788271798.023201:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.023230:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.023239:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788271798.023244:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271798.023249:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.023292:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.023324:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 10 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271798.023356:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875138586945408:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271798.028518:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788271798.028535:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1788271798.028576:0:3279:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab6eda28380 x1875138586945280/t4294967322(4294967322) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788271814 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788271798.028591:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6eda28380/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788271798.028598:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586945280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788271798.028950:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271798.033221:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271798.033885:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574382464 00000100:00100000:2.0:1788271798.033900:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574382464 00000100:00100000:2.0:1788271798.033980:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:2.0:1788271798.033994:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+11:2353:x1875138574382464:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788271798.042992:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271798.043644:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574382592 00000100:00100000:0.0:1788271798.043657:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574382592 00010000:00010000:0.0:1788271798.043714:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 12 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271798.043790:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:0.0:1788271798.043803:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:2353:x1875138574382592:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271798.043823:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271798.043830:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 12 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.043847:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 12 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.043880:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271798.043886:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271798.043894:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.043905:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.043934:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271798.044019:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+12:2353:x1875138574382592:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 218us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271798.044027:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 83 00010000:00010000:3.0:1788271798.045177:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2911731/0xbeb05ca97b5f7ec7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.1@tcp remote: 0x769326461023b4d expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271798.045202:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875138586945408:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271798.045248:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.045260:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.045267:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.045279:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.045288:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.045323:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271798.045652:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271798.045661:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.045685:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271798.045690:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.045700:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.045720:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.045726:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d84575df/0xbeb05ca97b5f810c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.045747:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271798.045749:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271798.045750:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271798.046846:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586945152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23698us (23833us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788271798.046861:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1788271798.047052:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6eda29500/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788271798.047061:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586945152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788271798.091816:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+10:2353:x1875138574382464:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 57807us (58590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271798.091833:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00000001:00080000:0.0:1788271798.096472:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1788271798.096707:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1788271798.096717:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788271798.097293:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.097683:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574382848 00000100:00100000:3.0:1788271798.097699:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574382848 00000100:00100000:3.0:1788271798.097781:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:3.0:1788271798.097796:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11648:x1875138574382848:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271798.097898:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271798.097939:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18e00/0xbeb05ca97b5f80f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023be0 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.097974:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:3.0:1788271798.097981:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271798.098026:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.098045:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.098056:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271798.098779:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056db0297 reply state 000000007370dafa transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271798.098794:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271798.099088:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:11648:x1875138574382848:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1291us (1800us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788271798.099100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:3.0:1788271798.105802:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:0.0:1788271798.105901:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.105918:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.105927:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.105934:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271798.105939:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.105948:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.105980:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:0.0:1788271798.105983:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271798.105989:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.105995:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271798.106314:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574382976 00000100:00100000:2.0:1788271798.106328:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574382976 00000100:00100000:2.0:1788271798.106439:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:2.0:1788271798.106452:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574382976:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788271798.107091:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788271798.107097:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788271797 -> 1788271796 00002000:00010000:2.0:1788271798.107099:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788271796 00002000:00010000:2.0:1788271798.107102:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788271797 -> 1788271796 00002000:00010000:2.0:1788271798.107104:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788271798.107380:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574382976:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 927us (1589us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788271798.107787:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:0.0:1788271798.114375:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.114716:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574383232 00000100:00100000:3.0:1788271798.114730:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574383232 00000100:00100000:3.0:1788271798.114818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 229 00000100:00100000:3.0:1788271798.114832:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11648:x1875138574383232:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788271798.114942:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.114991:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.115004:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.115059:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.115076:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 20 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271798.115095:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586945536:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271798.115249:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff370900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271798.120835:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875138586945536:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271798.120876:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271798.124292:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.124700:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574383360 00000100:00100000:3.0:1788271798.124713:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574383360 00010000:00010000:3.0:1788271798.124769:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271798.124821:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:3.0:1788271798.124831:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:2354:x1875138574383360:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271798.124849:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271798.124857:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.124872:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.124928:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f80d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd2 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.124959:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:3.0:1788271798.124966:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.124977:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.124986:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.125025:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271798.125098:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:2354:x1875138574383360:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 268us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271798.125106:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 84 00010000:00010000:0.0:1788271798.126122:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126137:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126693:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126721:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126730:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126736:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271798.126741:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126751:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126770:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:0.0:1788271798.126774:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788271798.126779:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.126785:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19c00/0xbeb05ca97b5f811a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271798.126897:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11648:x1875138574383232:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 12057us (12526us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788271798.126909:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 229 00000100:00100000:0.0:1788271798.131992:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.132095:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574383488 00000100:00100000:3.0:1788271798.132110:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574383488 00000100:00100000:3.0:1788271798.132199:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:3.0:1788271798.132212:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574383488:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788271798.132276:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.132317:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.132358:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271798.132364:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271798.132369:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.132446:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.132463:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 8 pid: 6697 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271798.132481:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875138586945664:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271798.132598:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff3703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271798.137084:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875138586945664:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271798.137138:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271798.139624:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271798.139855:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574383616 00000100:00100000:2.0:1788271798.139867:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574383616 00010000:00010000:2.0:1788271798.139930:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 9 pid: 6697 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271798.139992:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:2.0:1788271798.140003:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+9:2354:x1875138574383616:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271798.140023:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271798.140055:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 9 pid: 6697 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.140072:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 9 pid: 6697 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.140102:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000404ee589/0xbeb05ca97b5f80fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x769326461023bee expref: 9 pid: 6697 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.140125:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271798.140130:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271798.140136:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.140148:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.140224:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271798.140302:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2354:x1875138574383616:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 299us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271798.140310:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00010000:00010000:3.0:1788271798.140532:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140544:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140576:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140586:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140605:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140612:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271798.140617:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140627:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140640:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.140649:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bb55940/0xbeb05ca97b5f8121 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271798.140702:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574383488:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 8493us (8726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271798.140710:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:3.0:1788271798.145337:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271798.145616:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574383872 00000100:00100000:0.0:1788271798.145629:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574383872 00000100:00100000:0.0:1788271798.145707:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 230 00000100:00100000:0.0:1788271798.145720:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11648:x1875138574383872:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788271798.145847:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.145868:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.145882:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.146330:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.146345:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.146355:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.146396:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.146493:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 20 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271798.146635:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586945792:192.168.201.1@tcp:104: 00000100:00100000:0.0:1788271798.146736:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ca575300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271798.152901:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.153517:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586945792:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271798.153558:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271798.153790:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574384000 00000100:00100000:1.0:1788271798.153799:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574384000 00010000:00010000:1.0:1788271798.153856:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271798.153918:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:1.0:1788271798.153930:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:2354:x1875138574384000:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271798.153983:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271798.153992:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.154007:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.154036:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19000/0xbeb05ca97b5f80e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bd9 expref: 21 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.154057:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:1.0:1788271798.154063:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.154075:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.154083:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.154116:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271798.154314:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271798.154331:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271798.154644:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788271798.154837:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788271798.154886:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788271798.155018:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc98380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586945920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788271798.155597:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:2354:x1875138574384000:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1664us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271798.155610:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:2.0:1788271798.158814:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271798.158874:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ff3706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271798.159916:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586945920 00000100:00100000:3.0:1788271798.159931:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586945920 00000100:00100000:3.0:1788271798.160017:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788271798.160029:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5839:x1875138586945920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788271798.160175:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5839:x1875138586945920:12345-0@lo:1000:mdt00_002.0 Request processed in 148us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271798.160183:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271798.160882:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788271798.160900:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6eda28380, transno 4294967322 00000100:00100000:2.0:1788271798.160926:0:5839:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab6eda29500 x1875138586945152/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788271814 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271798.160940:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc98380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586945920:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788271798.164380:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788271798.164730:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586946048:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788271798.164824:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271798.164873:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271798.165137:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586946048 00000100:00100000:3.0:1788271798.165146:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586946048 00000100:00100000:3.0:1788271798.165224:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271798.165237:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875138586946048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788271798.165855:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1875138586946048:12345-0@lo:1000:mdt00_002.0 Request processed in 619us (1029us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788271798.165865:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271798.166025:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875138586946048:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788271798.166080:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166093:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166102:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166109:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271798.166130:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166139:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166161:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6c4f64100) 00010000:00010000:2.0:1788271798.166164:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271798.166171:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166178:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f812f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166232:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166240:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166246:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166250:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024ac00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271798.166253:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166259:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166266:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271798.166269:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271798.166283:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166312:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166323:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.166358:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271798.166373:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586946176:192.168.201.1@tcp:105: 00000100:00100000:2.0:1788271798.168081:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271798.172329:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.172443:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574384128 00000100:00100000:3.0:1788271798.172455:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574384128 00000100:00100000:3.0:1788271798.172538:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:3.0:1788271798.172551:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11647:x1875138574384128:12345-192.168.201.1@tcp:49:lfs.0 00000100:00100000:3.0:1788271798.172727:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11647:x1875138574384128:12345-192.168.201.1@tcp:49:lfs.0 Request processed in 178us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271798.172757:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:0.0:1788271798.176613:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271798.176751:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574384384 00000100:00100000:1.0:1788271798.176765:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574384384 00000100:00100000:1.0:1788271798.176836:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 231 00000100:00100000:1.0:1788271798.176848:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11647:x1875138574384384:12345-192.168.201.1@tcp:58:lfs.0 00000040:00080000:1.0:1788271798.177688:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788271798.177817:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11647:x1875138574384384:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 968us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271798.177827:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 231 00000100:00100000:2.0:1788271798.178856:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586946176:192.168.201.1@tcp:105: 00010000:00010000:2.0:1788271798.178903:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.178917:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f8072 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.178970:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.178988:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179003:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179035:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179042:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179048:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179055:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271798.179059:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179067:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179082:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271798.179085:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271798.179089:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179095:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8136 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179105:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179112:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179118:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179130:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271798.179133:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179138:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179147:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271798.179625:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271798.179630:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.179637:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8128 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271798.179869:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:11648:x1875138574383872:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 34147us (34544us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788271798.179880:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 230 00000020:00080000:2.0:1788271798.179896:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788271798.180480:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271798.180508:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271798.180564:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788271798.180573:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788271798.180718:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b2b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586946304:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271798.180797:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ca575300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271798.192739:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271798.193581:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574384640 00000100:00100000:1.0:1788271798.193596:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574384640 00000100:00100000:1.0:1788271798.193679:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:1.0:1788271798.193692:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+24:11648:x1875138574384640:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788271798.194593:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788271798.194753:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788271798.194811:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.194832:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.194846:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.194857:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.194863:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.194870:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.194892:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788271798.195034:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+26:11648:x1875138574384640:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 1342us (2306us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788271798.195052:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000020:00080000:1.0:1788271798.195059:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788271798.195853:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271798.195866:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.195877:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271798.195882:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.196696:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.196721:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab6cb419800) 00010000:00010000:0.0:1788271798.196724:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788271798.196731:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.196737:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6e00/0xbeb05ca97b5f813d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.196767:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271798.196770:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271798.196773:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271798.197925:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b2b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875138586946304:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271798.202201:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271798.202324:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574384768 00000100:00100000:2.0:1788271798.202339:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574384768 00000100:00100000:2.0:1788271798.202452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 232 00000100:00100000:2.0:1788271798.202466:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+25:11649:x1875138574384768:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788271798.202526:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788271798.202661:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+25:11649:x1875138574384768:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 197us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271798.202670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 232 00000100:00100000:3.0:1788271798.209112:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271798.209834:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574385024 00000100:00100000:0.0:1788271798.209851:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574385024 00000100:00100000:0.0:1788271798.209967:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 233 00000100:00100000:0.0:1788271798.209985:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+25:11649:x1875138574385024:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271798.210021:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271798.210052:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8144 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bf5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.210183:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f814b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.210203:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.210228:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271798.210241:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788271798.210445:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8144 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bf5 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.210466:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f814b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bf5 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.210476:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271798.210479:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788271798.210484:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374600, rc 0) 00000100:00100000:0.0:1788271798.210566:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11649:x1875138574385024:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 588us (1962us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788271798.210574:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 233 00000100:00100000:2.0:1788271798.221076:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271798.221175:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574385280 00000100:00100000:0.0:1788271798.221206:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574385280 00000100:00100000:0.0:1788271798.221304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 234 00000100:00100000:0.0:1788271798.221317:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+27:11649:x1875138574385280:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788271798.221521:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221542:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221557:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221803:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221812:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221820:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221827:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271798.221832:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221841:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221856:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271798.221859:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271798.221864:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.221882:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271798.222092:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11649:x1875138574385280:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 775us (1027us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788271798.222102:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 234 00000040:00080000:0.0:1788271798.223747:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271798.223758:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788271798.226727:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.226794:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574385536 00000100:00100000:3.0:1788271798.226808:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574385536 00000100:00100000:3.0:1788271798.226892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:3.0:1788271798.226904:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+28:11649:x1875138574385536:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271798.227248:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:11649:x1875138574385536:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 344us (535us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788271798.227257:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000040:00080000:0.0:1788271798.227297:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788271798.227312:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788271798.244816:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271798.244964:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574385664 00000100:00100000:0.0:1788271798.244978:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574385664 00000100:00100000:0.0:1788271798.245099:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 235 00000100:00100000:0.0:1788271798.245112:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+29:11651:x1875138574385664:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1788271798.245212:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271798.245242:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8160 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023bfc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.245331:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.245348:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.245362:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.245380:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.245665:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271798.245673:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.247126:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.247222:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.247233:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.247285:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.247305:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 30 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271798.247323:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586946432:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271798.248072:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77d8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271798.252226:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875138586946432:192.168.201.1@tcp:104: 00010000:00010000:2.0:1788271798.252271:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271798.252695:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271798.252981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574385920 00000100:00100000:3.0:1788271798.252992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574385920 00000100:00100000:3.0:1788271798.253069:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:3.0:1788271798.253082:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+31:5593:x1875138574385920:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788271798.253492:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:5593:x1875138574385920:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 411us (797us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788271798.253502:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:1.0:1788271798.256667:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271798.256738:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574386048 00000100:00100000:2.0:1788271798.256751:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574386048 00010000:00010000:2.0:1788271798.256803:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 32 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271798.256854:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:2.0:1788271798.256866:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:2354:x1875138574386048:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271798.256895:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271798.256903:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 32 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.256920:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 32 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.256962:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374000/0xbeb05ca97b5f8064 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023bb6 expref: 32 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.256985:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271798.256993:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.257006:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.257037:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271798.257078:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271798.257279:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+31:2354:x1875138574386048:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 412us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271798.257288:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 87 00010000:00010000:1.0:1788271798.257927:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.257939:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271798.258010:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788271798.258016:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271798.258056:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258075:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258087:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258094:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258101:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258107:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271798.258113:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258121:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258135:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:1.0:1788271798.258138:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271798.258142:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258148:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374200/0xbeb05ca97b5f8167 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258162:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258169:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258183:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258189:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271798.258192:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258198:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258207:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab6c2fd1700) 00010000:00010000:1.0:1788271798.258210:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271798.258213:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258218:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375a00/0xbeb05ca97b5f816e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258264:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375c00/0xbeb05ca97b5f8160 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bfc expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258279:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bfc expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271798.258287:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:1.0:1788271798.258289:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271798.258292:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7800, rc 0) 00000100:00100000:1.0:1788271798.258358:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:11651:x1875138574385664:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 13248us (13553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271798.258376:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 235 00010000:00010000:1.0:1788271798.259685:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271799.133844:0:12616:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271799.135364:0:12616:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271799.139408:0:12616:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788271799.139439:0:12616:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271799.284777:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586946816:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.284895:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.285083:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586946688:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.285124:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.285148:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586947200:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.285180:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.285224:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788271799.285233:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586946560:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.285273:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.285306:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586947072:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.285360:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.285450:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586946816 00000100:00100000:2.0:1788271799.285454:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586946688 00000100:00100000:0.0:1788271799.285462:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586946816 00000100:00100000:2.0:1788271799.285471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586946688 00000100:00100000:0.0:1788271799.285539:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947072 00000100:00100000:0.0:1788271799.285545:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947072 00000100:00100000:1.0:1788271799.285637:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271799.285647:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586946944:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.285679:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.288481:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788271799.288509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586946816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.288658:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586946816:12345-0@lo:400:kworker.0 Request processed in 160us (3762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271799.288678:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788271799.288704:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586946688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.288828:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586946688:12345-0@lo:400:kworker.0 Request processed in 135us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.288830:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788271799.288845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788271799.288883:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788271799.288897:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586947072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.289169:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947200 00000100:00100000:1.0:1788271799.289178:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947200 00000100:00100000:1.0:1788271799.289223:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586946944 00000100:00100000:1.0:1788271799.289227:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586946944 00000100:00100000:1.0:1788271799.289252:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271799.289259:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1875138586947200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.289631:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1875138586947200:12345-0@lo:400:kworker.0 Request processed in 371us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271799.289639:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271799.289655:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788271799.289662:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586946944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.289696:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586946944:12345-0@lo:400:kworker.0 Request processed in 35us (4017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271799.289703:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788271799.289731:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586947456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271799.289775:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.289809:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271799.289815:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586947328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271799.289851:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.291042:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947456 00000100:00100000:1.0:1788271799.291058:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947456 00000100:00100000:1.0:1788271799.291116:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947328 00000100:00100000:1.0:1788271799.291120:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947328 00000100:00100000:1.0:1788271799.291141:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788271799.291153:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875138586947456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271799.291204:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271799.291219:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788271799.291241:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875138586947328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271799.291271:0:9404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788271799.291292:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875138586947456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271799.291302:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788271799.291452:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586947456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788271799.291595:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271799.291818:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586947072:12345-0@lo:400:kworker.0 Request processed in 2911us (6444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.291828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788271799.291869:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586946560 00000100:00100000:0.0:1788271799.291874:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586946560 00000100:00100000:0.0:1788271799.291915:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788271799.291924:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586946560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.293628:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586946944:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.293656:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586946816:0@lo:400:kworker.0 00000100:00080000:1.0:1788271799.293789:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271799.293815:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875138586947328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2573us (3951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271799.293831:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788271799.293847:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586947072:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.293872:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586946688:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.293890:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586947200:0@lo:400:kworker.0 00000100:00100000:3.0:1788271799.294008:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586947328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271799.294294:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586946560:12345-0@lo:400:kworker.0 Request processed in 2367us (9019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.294305:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788271799.294404:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586946560:0@lo:400:kworker.0 00000100:00100000:3.0:1788271799.345361:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271799.345538:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574386304 00000100:00100000:2.0:1788271799.345552:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574386304 00000100:00100000:2.0:1788271799.345679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 236 00000100:00100000:2.0:1788271799.345690:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+30:11674:x1875138574386304:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271799.345717:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271799.345738:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f817c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023c03 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.345851:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f8183 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.345865:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f8183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.345876:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f8183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271799.345887:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788271799.346034:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f817c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c03 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.346050:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f8183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c03 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.346059:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271799.346062:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788271799.346065:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ba00, rc 0) 00000100:00100000:2.0:1788271799.346128:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11674:x1875138574386304:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 439us (780us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788271799.346135:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 236 00000100:00080000:0.0:1788271799.346966:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271799.348634:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271799.348785:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574386432 00000100:00100000:2.0:1788271799.348794:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574386432 00000100:00100000:2.0:1788271799.353026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 237 00000100:00100000:2.0:1788271799.353046:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11674:x1875138574386432:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:2.0:1788271799.353118:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353143:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353156:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353183:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353190:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353197:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353203:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271799.353207:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353215:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:2.0:1788271799.353232:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271799.353237:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271799.353242:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a400/0xbeb05ca97b5f8191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271799.353326:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:11674:x1875138574386432:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 286us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271799.353339:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 237 00000100:00100000:3.0:1788271799.454896:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271799.455661:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574386560 00000100:00100000:1.0:1788271799.455677:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574386560 00000100:00100000:1.0:1788271799.455777:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:1.0:1788271799.455792:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2351:x1875138574386560:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:1.0:1788271799.455818:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271799.455847:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564ad22e/0xbeb05ca97b5f8198 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023c0a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271799.455903:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a96dcb4, atime: 0x6a96dcb4, ctime: 0x6a96dcb4, blocks: 0xb 00010000:00010000:1.0:1788271799.455940:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1788271799.455946:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271799.455959:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564ad22e/0xbeb05ca97b5f8198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c0a expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271799.455982:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000564ad22e/0xbeb05ca97b5f8198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c0a expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271799.455999:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6800, rc 0) 00000100:00100000:1.0:1788271799.456078:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2351:x1875138574386560:12345-192.168.201.1@tcp:101:cat.0 Request processed in 290us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271799.456086:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00080000:0.0:1788271799.457308:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271799.461513:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271799.461605:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574386688 00000100:00100000:2.0:1788271799.461619:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574386688 00002000:00100000:2.0:1788271799.461676:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8ab6edc9b800 x1875138574386688/t0(0) o3->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:705/0 lens 488/0 e 0 to 0 dl 1788271810 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271799.461688:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6edc9b800 with x1875138574386688 ext(0->4095) 00002000:00010000:2.0:1788271799.461694:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6edc9b800 00000100:00100000:2.0:1788271799.461730:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1788271799.461741:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574386688:12345-192.168.201.1@tcp:3:cat.0 00000100:00100000:2.0:1788271799.462011:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574386688:12345-192.168.201.1@tcp:3:cat.0 Request processed in 271us (512us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788271799.462021:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00002000:00100000:2.0:1788271799.462028:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8ab6edc9b800 x1875138574386688/t0(0) o3->896349b1-dd1e-47e2-bcd1-0ecd5d75458e@192.168.201.1@tcp:705/0 lens 488/4536 e 0 to 0 dl 1788271810 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271799.462035:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6edc9b800 with x1875138574386688 ext(0->4095) 00002000:00010000:2.0:1788271799.462038:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab6edc9b800 00010000:00010000:1.0:1788271800.306971:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271801.330875:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788271801.917855:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788271801.917893:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788271801.967731:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271801.967772:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271801.967817:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271801.967839:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271801.967864:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271801.967904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574386816 00000100:00100000:1.0:1788271801.967914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574386816 00000100:00100000:1.0:1788271801.967961:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 294 00000100:00100000:1.0:1788271801.967973:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574386816:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271801.968055:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574386816:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271801.968063:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 294 00000100:00100000:1.0:1788271801.968096:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574387200 00000100:00100000:1.0:1788271801.968101:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574387200 00000100:00100000:1.0:1788271801.968135:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574387072 00000100:00100000:1.0:1788271801.968138:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574387072 00000100:00100000:1.0:1788271801.968160:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:1.0:1788271801.968167:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574387200:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271801.968197:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574387200:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271801.968204:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:1.0:1788271801.968216:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:1.0:1788271801.968222:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574387072:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271801.968245:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+8:2353:x1875138574387072:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271801.968251:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:1.0:1788271801.968268:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574386944 00000100:00100000:1.0:1788271801.968272:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574386944 00000100:00100000:1.0:1788271801.968298:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574387328 00000100:00100000:1.0:1788271801.968301:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574387328 00000100:00100000:1.0:1788271801.968320:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 152 00000100:00100000:1.0:1788271801.968326:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:2353:x1875138574386944:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271801.968353:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+32:2353:x1875138574386944:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271801.968369:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 152 00000100:00100000:1.0:1788271801.968381:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 153 00000100:00100000:1.0:1788271801.968388:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574387328:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271801.968450:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2353:x1875138574387328:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 62us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271801.968456:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 153 00000100:00080000:1.0:1788271801.968609:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271801.968614:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271801.968615:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788271802.355428:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271803.379745:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788271803.454408:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:3.0:1788271803.454462:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788271803.454475:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab7015f86c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788271803.454481:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6edd0e400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab7015f8180 00000020:00080000:3.0:1788271803.454485:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6edd0e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6ffad5c00 00000020:00080000:3.0:1788271803.454519:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788271803.458247:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788271803.458551:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788271803.465663:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1788271803.465695:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:3.0:1788271804.059522:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271804.059699:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574387456 00000100:00100000:1.0:1788271804.059709:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574387456 00000100:00100000:1.0:1788271804.059786:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 238 00000100:00100000:1.0:1788271804.059797:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11327:x1875138574387456:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788271804.059927:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11327:x1875138574387456:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 Request processed in 132us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.059936:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 238 00000100:00080000:0.0:1788271804.060125:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271804.077821:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271804.078010:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574387712 00000100:00100000:2.0:1788271804.078026:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574387712 00000100:00100000:2.0:1788271804.078137:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:2.0:1788271804.078150:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:11327:x1875138574387712:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788271804.078825:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:11327:x1875138574387712:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 676us (1016us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788271804.078841:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:0.0:1788271804.403788:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586947840:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.403913:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271804.403992:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586948352:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.404027:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271804.404061:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788271804.404067:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586947968:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.404091:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271804.404111:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586948480:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.404141:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271804.404177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947840 00000100:00100000:0.0:1788271804.404187:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947840 00000100:00100000:1.0:1788271804.404372:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948352 00000100:00100000:3.0:1788271804.404373:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271804.404381:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948352 00000100:00100000:1.0:1788271804.404487:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947968 00000100:00100000:1.0:1788271804.404491:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947968 00000100:00100000:1.0:1788271804.404524:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788271804.404527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271804.404540:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586948352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.404579:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586948224:0@lo:400:kworker.0 00000100:00100000:1.0:1788271804.404880:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586948352:12345-0@lo:400:kworker.0 Request processed in 343us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.404906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788271804.404928:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788271804.404934:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586947968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271804.404972:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586947968:12345-0@lo:400:kworker.0 Request processed in 38us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.404978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788271804.404999:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948480 00000100:00100000:1.0:1788271804.405003:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948480 00000100:00100000:1.0:1788271804.405034:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788271804.405040:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586948480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271804.405074:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586948480:12345-0@lo:400:kworker.0 Request processed in 34us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.405080:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788271804.405100:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788271804.405108:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586947840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271804.405141:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586947840:12345-0@lo:400:kworker.0 Request processed in 34us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.405147:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1788271804.405185:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271804.405190:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788271804.405247:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271804.405588:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586947968:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.405616:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788271804.405624:0:3278:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788271804.405655:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6edf4d500, transno 4294967310 00000100:00100000:0.0:1788271804.405669:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586948480:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.405682:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586947840:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.405694:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586948352:0@lo:400:kworker.0 00000100:00100000:0.0:1788271804.406158:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947712 00000100:00100000:0.0:1788271804.406165:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947712 00000100:00100000:0.0:1788271804.406203:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788271804.406213:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586947712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271804.406250:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271804.407150:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586947584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271804.407231:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271804.407928:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586948096:0@lo:400:kworker.0 00000100:00100000:1.0:1788271804.407980:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271804.408303:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586947712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2089us (3783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271804.408314:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271804.409046:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271804.409172:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271804.409287:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586947584 00000100:00100000:3.0:1788271804.409295:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586947584 00000100:00100000:3.0:1788271804.409353:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271804.409364:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586947584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271804.409400:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271804.410800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948096 00000100:00100000:0.0:1788271804.410820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948096 00000100:00100000:0.0:1788271804.410907:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788271804.410920:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586948096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.411815:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948224 00000100:00100000:2.0:1788271804.411825:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948224 00000100:00100000:2.0:1788271804.411889:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788271804.411899:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fee63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1875138586948224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.411987:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fee63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1875138586948224:12345-0@lo:400:kworker.0 Request processed in 88us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271804.411996:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788271804.412185:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271804.412192:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271804.412667:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788271804.412675:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6eda29500, transno 4294967323 00000004:00080000:2.0:1788271804.412692:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788271804.412731:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586948224:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.414062:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586947584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4689us (6819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.414096:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788271804.414192:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586948096:12345-0@lo:400:kworker.0 Request processed in 3268us (6204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271804.414207:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788271804.417656:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586947584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271804.417685:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586948096:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.475279:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271804.475410:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574387840 00000100:00100000:2.0:1788271804.475450:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574387840 00000100:00100000:2.0:1788271804.475650:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 239 00000100:00100000:2.0:1788271804.475665:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:12125:x1875138574387840:12345-192.168.201.1@tcp:101:lsof.0 00010000:00010000:2.0:1788271804.475692:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271804.475720:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f819f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023c11 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271804.475803:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f81a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271804.475821:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271804.475874:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271804.476269:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788271804.476274:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271804.476361:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271804.476395:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f819f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c11 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271804.476450:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f81a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c11 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271804.476460:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:2.0:1788271804.476463:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271804.476468:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ac00, rc 0) 00000100:00100000:2.0:1788271804.476560:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:12125:x1875138574387840:12345-192.168.201.1@tcp:101:lsof.0 Request processed in 899us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271804.476569:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 239 00000100:00080000:1.0:1788271804.480650:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788271805.426882:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271806.450758:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271806.450772:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271806.451398:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788271806.451407:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788271806.451896:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271807.083948:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271807.084054:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271807.084083:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271807.084101:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271807.084121:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271807.084150:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574388480 00000100:00100000:3.0:1788271807.084160:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574388480 00000100:00100000:3.0:1788271807.084234:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574388096 00000100:00100000:3.0:1788271807.084237:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574388096 00000100:00100000:3.0:1788271807.084266:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 157 00000100:00100000:3.0:1788271807.084277:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2353:x1875138574388480:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271807.084374:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2353:x1875138574388480:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271807.084382:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 157 00000100:00100000:3.0:1788271807.084404:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:3.0:1788271807.084451:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:2353:x1875138574388096:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271807.084493:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:2353:x1875138574388096:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 82us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271807.084500:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:3.0:1788271807.084532:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574388224 00000100:00100000:3.0:1788271807.084536:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574388224 00000100:00100000:3.0:1788271807.084565:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574388352 00000100:00100000:3.0:1788271807.084568:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574388352 00000100:00100000:3.0:1788271807.084593:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:3.0:1788271807.084599:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574388224:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271807.084631:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2353:x1875138574388224:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 32us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271807.084638:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:3.0:1788271807.084650:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:3.0:1788271807.084656:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574388352:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271807.084680:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2353:x1875138574388352:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271807.084687:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00080000:3.0:1788271807.084702:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271807.084707:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271807.084710:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271807.086085:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574387968 00000100:00100000:0.0:1788271807.086098:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574387968 00000100:00100000:0.0:1788271807.086399:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 296 00000100:00100000:0.0:1788271807.086428:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574387968:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271807.086586:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2353:x1875138574387968:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 175us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271807.086596:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 296 00010000:00010000:3.0:1788271807.482980:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788271807.851053:0:12818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:10:05 (1788271805) 00010000:00010000:1.0:1788271808.505246:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788271808.551561:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788271808.551580:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788271808.551626:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788271808.551647:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788271809.522723:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586948608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271809.522830:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.522893:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948608 00000100:00100000:3.0:1788271809.522909:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948608 00000100:00080000:2.0:1788271809.522988:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271809.523012:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271809.523029:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586948608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271809.523084:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271809.523200:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586948608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271809.523231:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271809.523278:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586948736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271809.523455:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586948608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271809.523526:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271809.523572:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271809.523625:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948736 00000100:00100000:1.0:1788271809.523633:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948736 00000100:00100000:1.0:1788271809.523700:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788271809.523711:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586948736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271809.523745:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271809.523813:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586948736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.523821:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788271809.523888:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271809.524712:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586948736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271809.526108:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586948864:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.526183:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271809.526239:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271809.526246:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586948992:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.526275:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271809.526305:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586949120:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.526329:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271809.526346:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271809.526352:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586949248:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.526374:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271809.526470:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948864 00000100:00100000:1.0:1788271809.526479:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948864 00000100:00100000:3.0:1788271809.526509:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586948992 00000100:00100000:3.0:1788271809.526521:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586948992 00000100:00100000:3.0:1788271809.526593:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586949120 00000100:00100000:3.0:1788271809.526597:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586949120 00000100:00100000:2.0:1788271809.526610:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586949248 00000100:00100000:2.0:1788271809.526618:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586949248 00000100:00100000:3.0:1788271809.526646:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788271809.526661:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586948992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.526675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788271809.526688:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586949120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.526784:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586948992:12345-0@lo:400:kworker.0 Request processed in 125us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271809.526789:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586949120:12345-0@lo:400:kworker.0 Request processed in 102us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271809.526802:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788271809.527375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788271809.527387:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586948864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271809.527472:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3278:x1875138586948864:12345-0@lo:400:kworker.0 Request processed in 88us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.527480:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788271809.530138:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788271809.530178:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788271809.530223:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586949248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.530328:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875138586949248:12345-0@lo:400:kworker.0 Request processed in 141us (3952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271809.530336:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788271809.530384:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586949248:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.530400:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586949120:0@lo:400:kworker.0 00000100:00080000:3.0:1788271809.530901:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271809.530966:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586948992:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.530986:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586948864:0@lo:400:kworker.0 00010000:00010000:1.0:1788271810.546588:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271811.528257:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271811.529114:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574388736 00000100:00100000:1.0:1788271811.529131:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574388736 00000100:00100000:1.0:1788271811.529226:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:1.0:1788271811.529244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+19:12346:x1875138574388736:12345-192.168.201.1@tcp:35:umount.0 00000100:00080000:3.0:1788271811.529247:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271811.532219:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:12346:x1875138574388736:12345-192.168.201.1@tcp:35:umount.0 Request processed in 2968us (3964us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788271811.532249:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:3.0:1788271811.536507:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271811.536632:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574388992 00000100:00100000:2.0:1788271811.536666:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574388992 00000100:00100000:2.0:1788271811.536758:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:2.0:1788271811.536771:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+20:12346:x1875138574388992:12345-192.168.201.1@tcp:35:umount.0 00000100:00100000:2.0:1788271811.537285:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:12346:x1875138574388992:12345-192.168.201.1@tcp:35:umount.0 Request processed in 515us (1028us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788271811.537295:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:3.0:1788271811.543466:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271811.543725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574389248 00000100:00100000:2.0:1788271811.543740:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574389248 00000100:00100000:2.0:1788271811.543892:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:2.0:1788271811.543905:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c82edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+21:12346:x1875138574389248:12345-192.168.201.1@tcp:35:umount.0 00000100:00100000:2.0:1788271811.545630:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c82edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:12346:x1875138574389248:12345-192.168.201.1@tcp:35:umount.0 Request processed in 1717us (2168us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788271811.545645:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:0.0:1788271811.553968:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271811.554048:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574389504 00000100:00100000:1.0:1788271811.554073:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574389504 00000100:00100000:1.0:1788271811.554162:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:1.0:1788271811.554175:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+22:12346:x1875138574389504:12345-192.168.201.1@tcp:35:umount.0 00000100:00100000:0.0:1788271811.555002:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:12346:x1875138574389504:12345-192.168.201.1@tcp:35:umount.0 Request processed in 822us (1036us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788271811.555015:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:3.0:1788271811.564114:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271811.564536:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271811.564665:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574389632 00000100:00100000:2.0:1788271811.564679:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574389632 00000100:00100000:2.0:1788271811.564769:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574389888 00000100:00100000:2.0:1788271811.564773:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574389888 00000100:00100000:2.0:1788271811.564804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1788271811.564817:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:248429c1-4bc1-48f2-96f4-7358aba5f110+14:2352:x1875138574389632:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271811.564836:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271811.564861:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee18200/0xbeb05ca97b5f721e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x76932646102379c expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271811.564881:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271811.565839:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:0.0:1788271811.565866:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:248429c1-4bc1-48f2-96f4-7358aba5f110+13:2352:x1875138574389888:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271811.565887:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271811.565911:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee19800/0xbeb05ca97b5f7424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023867 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.565928:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271811.568574:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:248429c1-4bc1-48f2-96f4-7358aba5f110+12:2352:x1875138574389632:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 3731us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271811.568595:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:3.0:1788271811.569788:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271811.569993:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271811.570091:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574389760 00000100:00100000:2.0:1788271811.570104:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574389760 00000100:00100000:2.0:1788271811.570191:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:2.0:1788271811.570203:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248429c1-4bc1-48f2-96f4-7358aba5f110+12:2352:x1875138574389760:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271811.570220:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271811.570246:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2a00/0xbeb05ca97b5f7184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023764 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271811.570283:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271811.574914:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248429c1-4bc1-48f2-96f4-7358aba5f110+11:2352:x1875138574389760:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 4693us (5114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271811.574934:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:2.0:1788271811.575518:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574390016 00000100:00100000:2.0:1788271811.575536:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574390016 00000100:00100000:2.0:1788271811.575640:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:2.0:1788271811.575653:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2350:x1875138574390016:12345-192.168.201.1@tcp:9:umount.0 00000020:00000080:2.0:1788271811.575704:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f74f6 00000100:00080000:2.0:1788271811.575728:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ab6f735e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271811.575780:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788271811.575971:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2352:x1875138574389888:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 10089us (11404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271811.575990:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00010000:00010000:0.0:1788271811.576160:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271811.576178:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271811.576208:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+2:2350:x1875138574390016:12345-192.168.201.1@tcp:9:umount.0 Request processed in 553us (6210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271811.576217:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 73 00010000:00010000:0.0:1788271811.585115:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271811.585487:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271811.585664:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574390400 00000100:00100000:3.0:1788271811.585692:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574390400 00000100:00100000:3.0:1788271811.585778:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:3.0:1788271811.585788:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2350:x1875138574390400:12345-192.168.201.1@tcp:9:umount.0 00000020:00000080:3.0:1788271811.585827:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7757 00000020:00010000:3.0:1788271811.585838:0:6700:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab6f73f4000: total 0 00000100:00080000:3.0:1788271811.585842:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8ab6f73f0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788271811.585886:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1788271811.586198:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271811.587290:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+5:2350:x1875138574390400:12345-192.168.201.1@tcp:9:umount.0 Request processed in 1493us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271811.587302:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00000020:00010000:3.0:1788271811.587340:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab6f73f4000: total 0 00010000:00010000:3.0:1788271811.587370:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab6f73f4000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788271811.587459:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3238f43/0xbeb05ca97b5f7afa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a3c expref: 4 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271811.587501:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564ad22e/0xbeb05ca97b5f8198 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c0a expref: 3 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271811.587518:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab6f73f4000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788271811.587528:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271811.587530:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271811.587532:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271811.605044:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271811.605180:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574391424 00000100:00100000:2.0:1788271811.605194:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574391424 00000100:00100000:2.0:1788271811.605281:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 240 00000100:00100000:2.0:1788271811.605293:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+23:2350:x1875138574391424:12345-192.168.201.1@tcp:39:umount.0 00000020:00000080:2.0:1788271811.605339:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7192 00000020:00010000:2.0:1788271811.605377:0:5839:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab6e5822800: total 0 00000100:00080000:2.0:1788271811.605384:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8ab6e5827800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271811.605458:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1788271811.605800:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab6e5822800: total 0 00010000:00010000:0.0:1788271811.605805:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271811.605858:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab6e5822800, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1788271811.605902:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:0.0:1788271811.605906:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271811.605924:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374a00/0xbeb05ca97b5f7b5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a58 expref: 22 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.605950:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c2fd1d00) 00010000:00010000:0.0:1788271811.605953:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271811.605957:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375200/0xbeb05ca97b5f7478 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x76932646102387c expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.605979:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271811.605981:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788271811.605986:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ba00/0xbeb05ca97b5f8183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c03 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.605999:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271811.606001:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271811.606006:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b000/0xbeb05ca97b5f7abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a27 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606019:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271811.606021:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788271811.606025:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19200/0xbeb05ca97b5f7ae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a35 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606039:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271811.606041:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788271811.606045:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374600/0xbeb05ca97b5f814b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bf5 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606058:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271811.606066:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788271811.606071:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff374c00/0xbeb05ca97b5f77b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023963 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606087:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab6c4f64400) 00010000:00010000:0.0:1788271811.606089:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271811.606094:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f745c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023875 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606110:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:0.0:1788271811.606113:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788271811.606117:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375000/0xbeb05ca97b5f7e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023b31 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606129:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab6c3e3c400) 00010000:00010000:0.0:1788271811.606131:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788271811.606135:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18600/0xbeb05ca97b5f74cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023891 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606150:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271811.606152:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271811.606156:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a800/0xbeb05ca97b5f8079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bbd expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606169:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab6c3e3cd00) 00010000:00010000:0.0:1788271811.606171:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271811.606174:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f8175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023bfc expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606202:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab6c4f64f00) 00010000:00010000:0.0:1788271811.606205:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788271811.606209:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f7b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023a5f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606235:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab6c3e3cf00) 00010000:00010000:0.0:1788271811.606237:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271811.606242:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6ff375600/0xbeb05ca97b5f79db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610239ef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271811.606256:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab6e5822800, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1788271811.606267:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271811.606269:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271811.606271:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271811.607274:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:896349b1-dd1e-47e2-bcd1-0ecd5d75458e+7:2350:x1875138574391424:12345-192.168.201.1@tcp:39:umount.0 Request processed in 1976us (2238us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788271811.607290:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 240 00000001:00100000:2.0:1788271812.151688:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:2.0:1788271812.151699:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ab6f7359800/896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:3.0:1788271812.151807:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6f7359800/896349b1-dd1e-47e2-bcd1-0ecd5d75458e for lustre-OST0001 00000020:00000080:3.0:1788271812.151851:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6f735e000 for lustre-OST0001 00000100:00100000:0.0:1788271812.202489:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271812.202525:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271812.202602:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574391680 00000100:00100000:3.0:1788271812.202613:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574391680 00000100:00100000:1.0:1788271812.202684:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574391552 00000100:00100000:1.0:1788271812.202689:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574391552 00000100:00100000:3.0:1788271812.202694:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 162 00000100:00100000:3.0:1788271812.202704:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2354:x1875138574391680:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271812.202727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 298 00000100:00100000:1.0:1788271812.202733:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574391552:12345-192.168.201.1@tcp:400:kworker.0 00000100:00080000:0.0:1788271812.202804:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271812.202875:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2354:x1875138574391680:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 172us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271812.202884:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 162 00000100:00100000:0.0:1788271812.203823:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2354:x1875138574391552:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 1083us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271812.203833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 298 00010000:00010000:3.0:1788271812.595284:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271812.984962:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271812.986496:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271812.991590:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271812.994172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574391808 00000100:00100000:2.0:1788271812.994193:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574391808 00000100:00100000:1.0:1788271812.995993:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574391936 00000100:00100000:1.0:1788271812.996011:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574391936 00000100:00100000:1.0:1788271812.996119:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1788271812.996131:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248429c1-4bc1-48f2-96f4-7358aba5f110+11:2351:x1875138574391808:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271812.996151:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271812.996177:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0030a00/0xbeb05ca97b5f726b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237db expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.996198:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271812.996452:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:3.0:1788271812.996465:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:248429c1-4bc1-48f2-96f4-7358aba5f110+10:2352:x1875138574391936:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271812.996477:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271812.996487:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee19e00/0xbeb05ca97b5f7264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237b1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.996499:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271812.996598:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248429c1-4bc1-48f2-96f4-7358aba5f110+9:2351:x1875138574391808:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 468us (11653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.996606:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:2.0:1788271812.998452:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574392064 00000100:00100000:2.0:1788271812.998470:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574392064 00000100:00100000:2.0:1788271812.998550:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:2.0:1788271812.998561:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6cc0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248429c1-4bc1-48f2-96f4-7358aba5f110+9:2352:x1875138574392064:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271812.998578:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271812.998600:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee6c00/0xbeb05ca97b5f7401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023860 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.998617:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271812.999338:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:248429c1-4bc1-48f2-96f4-7358aba5f110+8:2352:x1875138574391936:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 2872us (12849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271812.999350:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:0.0:1788271813.001114:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271813.001386:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574392320 00000100:00100000:3.0:1788271813.001407:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574392320 00000100:00100000:3.0:1788271813.001551:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 241 00000100:00100000:3.0:1788271813.001562:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+6:2350:x1875138574392320:12345-192.168.201.1@tcp:39:umount.0 00000020:00000080:3.0:1788271813.001616:0:8302:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7279 00000020:00010000:3.0:1788271813.001628:0:8302:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab6ca68a800: total 0 00000100:00080000:3.0:1788271813.001634:0:8302:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca688800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788271813.001665:0:8302:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788271813.001978:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5ae6258-8c0a-484f-8e0e-8fd260991b76+5:2350:x1875138574392320:12345-192.168.201.1@tcp:39:umount.0 Request processed in 416us (875us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788271813.001988:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 241 00000020:00010000:0.0:1788271813.003452:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab6ca68a800: total 0 00010000:00010000:0.0:1788271813.003527:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab6ca68a800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788271813.003575:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c2fd1400) 00010000:00010000:0.0:1788271813.003597:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271813.003611:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ac00/0xbeb05ca97b5f81a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c11 expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.003645:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab6ca68a800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788271813.003658:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271813.003660:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271813.003662:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271813.007618:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6cc0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248429c1-4bc1-48f2-96f4-7358aba5f110+7:2352:x1875138574392064:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 9037us (16022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271813.007641:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:0.0:1788271813.026286:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271813.026497:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574392576 00000100:00100000:1.0:1788271813.026511:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574392576 00000100:00100000:1.0:1788271813.026580:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 299 00000100:00100000:1.0:1788271813.026612:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+7:2350:x1875138574392576:12345-192.168.201.1@tcp:251:umount.0 00000020:00000080:1.0:1788271813.026671:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f716f 00000020:00010000:1.0:1788271813.026681:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab6eda3f800: total 0 00000100:00080000:1.0:1788271813.026686:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8ab6eda38000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788271813.026833:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab6eda3f800: total 0 00010000:00010000:3.0:1788271813.026844:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271813.026901:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab6eda3f800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788271813.026944:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f7225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x7693264610237a3 expref: 3 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271813.026965:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab6eda3f800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788271813.026975:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271813.026977:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271813.026979:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271813.027074:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:248429c1-4bc1-48f2-96f4-7358aba5f110+1:2350:x1875138574392576:12345-192.168.201.1@tcp:251:umount.0 Request processed in 464us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271813.027083:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 299 00000020:00000080:1.0:1788271813.027094:0:5832:0:(genops.c:885:class_export_put()) final put ffff8ab6eda3f800/248429c1-4bc1-48f2-96f4-7358aba5f110 00000020:00000080:2.0:1788271813.028187:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6eda3f800/248429c1-4bc1-48f2-96f4-7358aba5f110 for MGS 00000020:00000080:2.0:1788271813.029538:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6eda38000 for MGS 00010000:00010000:2.0:1788271813.618598:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788271813.703475:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1788271813.703502:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000001:00080000:3.0:1788271813.703510:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788271813.703518:0:5861:0:(genops.c:885:class_export_put()) final put ffff8ab6e5822800/896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000001:00100000:3.0:1788271813.703539:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5ae6258-8c0a-484f-8e0e-8fd260991b76 00000001:00080000:3.0:1788271813.703545:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788271813.703547:0:5861:0:(genops.c:885:class_export_put()) final put ffff8ab6ca68a800/d5ae6258-8c0a-484f-8e0e-8fd260991b76 00000020:00000080:3.0:1788271813.703563:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6e5822800/896349b1-dd1e-47e2-bcd1-0ecd5d75458e for lustre-MDT0000 00000020:00000080:3.0:1788271813.703642:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ca68a800/d5ae6258-8c0a-484f-8e0e-8fd260991b76 for lustre-MDT0000 00000020:00000080:3.0:1788271813.703673:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6e5827800 for lustre-MDT0000 00000020:00000080:3.0:1788271813.703689:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6ca688800 for lustre-MDT0000 00000001:00100000:3.0:1788271813.741813:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:3.0:1788271813.741828:0:6722:0:(genops.c:885:class_export_put()) final put ffff8ab6f73f4000/896349b1-dd1e-47e2-bcd1-0ecd5d75458e 00000020:00000080:3.0:1788271813.741860:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6f73f4000/896349b1-dd1e-47e2-bcd1-0ecd5d75458e for lustre-OST0000 00000020:00000080:3.0:1788271813.741921:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6f73f0800 for lustre-OST0000 00000100:00100000:3.0:1788271814.642807:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586949376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271814.643315:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.643398:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271814.643405:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586949504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271814.643472:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.643514:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586949376 00000100:00100000:3.0:1788271814.643524:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586949376 00000100:00100000:3.0:1788271814.644272:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586949504 00000100:00100000:3.0:1788271814.644280:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586949504 00000100:00100000:3.0:1788271814.644308:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788271814.644318:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586949376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271814.644364:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271814.644440:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586949376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.644448:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788271814.644469:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788271814.644475:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586949504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271814.644496:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271814.644523:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586949504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.644530:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788271814.644553:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271814.644557:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271814.645094:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586949632:0@lo:400:kworker.0 00000100:00100000:1.0:1788271814.645146:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271814.645185:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271814.645191:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586949760:0@lo:400:kworker.0 00000100:00100000:1.0:1788271814.645221:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271814.645253:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586949760 00000100:00100000:1.0:1788271814.645258:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586949760 00000100:00100000:1.0:1788271814.645296:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788271814.645305:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586949760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271814.645346:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586949760:12345-0@lo:400:kworker.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271814.645353:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788271814.645393:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586949760:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.645692:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586949504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271814.645712:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586949376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271814.645731:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586949888:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.645757:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.645775:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271814.645778:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586949632 00000100:00100000:3.0:1788271814.645781:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586950016:0@lo:400:kworker.0 00000100:00100000:1.0:1788271814.645782:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586949632 00000100:00100000:3.0:1788271814.645801:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271814.645811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788271814.645817:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586949632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271814.645853:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ca7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3280:x1875138586949632:12345-0@lo:400:kworker.0 Request processed in 36us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271814.645868:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788271814.645908:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586949632:0@lo:400:kworker.0 00010000:00010000:3.0:1788271814.645968:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271814.645980:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586949888 00000100:00100000:3.0:1788271814.645984:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586949888 00000100:00080000:1.0:1788271814.646031:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271814.646289:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950016 00000100:00100000:3.0:1788271814.646293:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950016 00000100:00100000:3.0:1788271814.646312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788271814.646319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.646358:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586949888:12345-0@lo:400:kworker.0 Request processed in 39us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.646365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788271814.646378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788271814.646385:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586950016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.646431:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586950016:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.646437:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1788271814.646473:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271814.646559:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586950016:0@lo:400:kworker.0 00000100:00100000:0.0:1788271814.646570:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586949888:0@lo:400:kworker.0 00000020:01000004:2.0:1788271814.835880:0:13018:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788271814.846571:0:13018:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788271814.846648:0:13018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.846681:0:13018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.846703:0:13018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.846711:0:13018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.846736:0:13018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788271814.846743:0:13018:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788271814.846775:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271814.846781:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788271814.846788:0:13018:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788271814.846822:0:13018:0:(import.c:65:import_set_state_nolock()) ffff8ab6fe9b8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788271814.846889:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586950144:0@lo:39:umount.0 00000100:00100000:2.0:1788271814.846975:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271814.847090:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950144 00000100:00100000:2.0:1788271814.847098:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950144 00000100:00100000:2.0:1788271814.847152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788271814.847163:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875138586950144:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788271814.847195:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f7e 00010000:00010000:3.0:1788271814.847458:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271814.847468:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.847478:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d3000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271814.847494:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.847504:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271814.847512:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271814.847531:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271814.847535:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788271814.847537:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788271814.847568:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.847575:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271814.847596:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.847603:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3000/0xbeb05ca97b5f71f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f71fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.847617:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271814.847619:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271814.847621:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271814.847630:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271814.847641:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586950272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271814.847697:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788271814.847821:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8ab6fe9bb000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788271814.847899:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3277:x1875138586950144:12345-0@lo:39:umount.0 Request processed in 736us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.847908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788271814.847923:0:5837:0:(genops.c:885:class_export_put()) final put ffff8ab6c7d36000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1788271814.847954:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950272 00000100:00100000:2.0:1788271814.847958:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950272 00000100:00100000:2.0:1788271814.847993:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788271814.848293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271814.848571:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+19:3281:x1875138586950272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271814.848586:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271814.848606:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee7200/0xbeb05ca97b5f71fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f71f4 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.848621:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271814.848671:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:3281:x1875138586950272:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.848678:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:2.0:1788271814.848705:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c7d36000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788271814.848767:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6fe9bb000 for lustre-MDT0000 00000100:00080000:2.0:1788271814.848818:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6fe9b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788271814.848830:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586950144:0@lo:39:umount.0 00000100:00080000:2.0:1788271814.848859:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271814.848862:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788271814.848867:0:13018:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788271814.849630:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586950272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271814.854558:0:13018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854587:0:13018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854596:0:13018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854605:0:13018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854653:0:13018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271814.854671:0:13018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854678:0:13018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854685:0:13018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854691:0:13018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854704:0:13018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271814.854713:0:13018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854719:0:13018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854724:0:13018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854730:0:13018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854736:0:13018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788271814.854742:0:13018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854754:0:13018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854760:0:13018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854765:0:13018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.854772:0:13018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788271814.854776:0:13018:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788271814.854812:0:13018:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788271814.854818:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788271814.854823:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271814.854829:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788271814.854838:0:13018:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab6c3071800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271814.854843:0:13018:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab6f757c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271814.854849:0:13018:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8ab6de9e0000) has exports, disconnecting them 00000020:00080000:2.0:1788271814.854854:0:13018:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab6c3071800), last request at 1788271814 00000020:00000080:2.0:1788271814.854863:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f70f1 00000100:00080000:2.0:1788271814.854885:0:13018:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3070800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788271814.854943:0:13018:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab6c3071800): rc 0 00000020:00000080:2.0:1788271814.854945:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6c3071800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788271814.854957:0:13018:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab6f757c800), last request at 1788271814 00000020:00000080:2.0:1788271814.854961:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7026 00000100:00080000:2.0:1788271814.854967:0:13018:0:(import.c:65:import_set_state_nolock()) ffff8ab6f757d800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788271814.854980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c3071800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1788271814.855606:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788271814.855618:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855628:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271814.855633:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855656:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271814.855675:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271814.855681:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271814.855684:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788271814.855687:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788271814.855738:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855746:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271814.855775:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855782:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031000/0xbeb05ca97b5f7202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7209 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855796:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788271814.855800:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855806:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148be00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271814.855808:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855816:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271814.855834:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271814.855840:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271814.855842:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788271814.855844:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788271814.855858:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855865:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271814.855893:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855900:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148be00/0xbeb05ca97b5f7129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7130 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855917:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271814.855920:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855927:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374800 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271814.855930:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855937:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271814.855943:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271814.855959:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788271814.855962:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788271814.855964:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788271814.855980:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.855986:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271814.855993:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.856000:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374800/0xbeb05ca97b5f742b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f7432 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.856092:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271814.856096:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.856103:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0030000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271814.856106:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.856113:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271814.856120:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271814.856125:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271814.856128:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788271814.856130:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788271814.856153:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.856160:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271814.856167:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.856174:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0030000/0xbeb05ca97b5f6edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f6ee4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.856187:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271814.856188:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271814.856190:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271814.856651:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586950400:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788271814.858768:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6c3070800 for lustre-MDT0000 00000020:00080000:2.0:1788271814.858806:0:13018:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab6f757c800): rc 0 00000020:00000080:2.0:1788271814.858810:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6f757c800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788271814.858829:0:13018:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa54082dabae0 00000020:00000080:2.0:1788271814.858843:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6f757c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788271814.858876:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6f757d800 for lustre-MDT0000 00000100:00080000:2.0:1788271814.858902:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788271814.858909:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788271814.858925:0:13018:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788271814.859014:0:13018:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788271814.859043:0:13018:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca68d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788271814.859062:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788271814.859064:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788271814.859073:0:13018:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788271814.859151:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586950912:0@lo:9:umount.0 00000100:00100000:2.0:1788271814.859247:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788271814.859316:0:13018:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788271814.859326:0:13018:0:(import.c:65:import_set_state_nolock()) ffff8ab6eda3c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788271814.859340:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586951040:0@lo:9:umount.0 00000100:00100000:2.0:1788271814.859363:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271814.859398:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950912 00000100:00100000:2.0:1788271814.859407:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950912 00000100:00100000:2.0:1788271814.859478:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586951040 00000100:00100000:2.0:1788271814.859482:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586951040 00000100:00100000:2.0:1788271814.859506:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788271814.859516:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875138586950912:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788271814.859545:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7073 00000100:00080000:2.0:1788271814.859556:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ab6fe9b8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271814.859609:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788271814.860021:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3277:x1875138586950912:12345-0@lo:9:umount.0 Request processed in 504us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.860029:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788271814.860052:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271814.860059:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875138586951040:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788271814.860075:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f715a 00000100:00080000:2.0:1788271814.860082:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee236800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271814.860099:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788271814.860297:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3277:x1875138586951040:12345-0@lo:9:umount.0 Request processed in 238us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.860304:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788271814.860357:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6eda3c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788271814.860367:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788271814.860369:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788271814.860373:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586951040:0@lo:9:umount.0 00000100:00080000:2.0:1788271814.860384:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca68d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788271814.860391:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788271814.860392:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788271814.860395:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586950912:0@lo:9:umount.0 00010000:00010000:2.0:1788271814.860455:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788271814.860504:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab6de9e0000) has no exports 00010000:00010000:2.0:1788271814.860798:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271814.862728:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586950528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271814.862827:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271814.862883:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950528 00000100:00100000:0.0:1788271814.862892:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950528 00000100:00100000:0.0:1788271814.862962:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788271814.862972:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+18:3278:x1875138586950528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271814.862989:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271814.863028:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3600/0xbeb05ca97b5f7130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f7129 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.863050:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271814.863086:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3278:x1875138586950528:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271814.863111:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271814.863737:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.863768:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950400 00000100:00100000:3.0:1788271814.863773:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950400 00000100:00100000:3.0:1788271814.863809:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271814.863818:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+17:3281:x1875138586950400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271814.863828:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271814.863840:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f7209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f7202 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.863854:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271814.863879:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3281:x1875138586950400:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.863886:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271814.863949:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586950400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271814.864049:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586950784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271814.864086:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.864352:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950784 00000100:00100000:3.0:1788271814.864368:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950784 00000100:00100000:3.0:1788271814.864398:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271814.864405:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+16:3280:x1875138586950784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271814.864439:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271814.864451:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0031400/0xbeb05ca97b5f6ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f6edd expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.864465:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271814.864509:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:3280:x1875138586950784:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.864515:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271814.864544:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e92ad5e1-0f38-442e-8a6a-19627f637d27:3280:1875138586950784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271814.868699:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586950656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271814.868807:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271814.868909:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586950656 00000100:00100000:1.0:1788271814.868920:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586950656 00000100:00100000:1.0:1788271814.868995:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788271814.869283:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e92ad5e1-0f38-442e-8a6a-19627f637d27+15:3279:x1875138586950656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271814.869305:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271814.869333:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f7432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f742b expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.869353:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271814.869400:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e92ad5e1-0f38-442e-8a6a-19627f637d27+14:3279:x1875138586950656:12345-0@lo:103:ldlm_bl.0 Request processed in 395us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271814.869408:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788271814.870513:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e92ad5e1-0f38-442e-8a6a-19627f637d27:3279:1875138586950656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271814.872516:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e92ad5e1-0f38-442e-8a6a-19627f637d27:3278:1875138586950528:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788271814.879769:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab6de9e0000) has no exports 00000020:00000080:3.0:1788271814.956819:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f38 00000020:00000080:3.0:1788271814.956836:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6fe9f5000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788271814.956868:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788271814.956910:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6fe9f5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788271814.957088:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271814.957107:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788271814.957113:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8ab6ffc63370) has no exports 00000020:00000080:0.0:1788271814.961838:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f31 00000020:00000080:0.0:1788271814.961853:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ee927800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788271814.962114:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271814.962125:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788271814.962129:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ee926000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788271814.962132:0:13018:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ee926000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788271814.962140:0:13018:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788271814.967344:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ee927800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788271814.967755:0:13018:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6ee1e1a80 - data ffff8ab6de74e000/ffff8ab6ed9d2c00 00000020:01000000:1.0:1788271814.967960:0:13018:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6ca6d8240 - data ffff8ab6d6f62af8/ffff8ab701cc6c00 00000001:00000004:1.0:1788271815.001409:0:13018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788271815.057576:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788271815.057598:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788271815.057681:0:13018:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788271815.057684:0:13018:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788271815.058354:0:7001:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788271815.058360:0:7001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788271815.058370:0:7001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788271815.059358:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788271815.059363:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788271815.059384:0:13018:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788271815.059387:0:13018:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788271815.059744:0:8055:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788271815.059748:0:8055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788271815.059758:0:8055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788271815.105700:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f00 00000020:00000080:1.0:1788271815.105726:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ffc55000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271815.106502:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ffc55000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788271815.106815:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f15 00000020:00000080:1.0:1788271815.106824:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ffc51000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788271815.106874:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788271815.106880:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271815.106888:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788271815.106891:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8ab6de9e4d28) has no exports 00000004:01000000:1.0:1788271815.107112:0:13018:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788271815.107121:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7153 00000020:00000080:1.0:1788271815.107126:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6eda39000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271815.109923:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ffc51000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788271815.110109:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6eda39000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788271815.110172:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788271815.110180:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271815.110192:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788271815.110198:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8ab6c57a99b8) has no exports 00000020:00000080:1.0:1788271815.110206:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f714c 00000020:00000080:1.0:1788271815.110214:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6f7331800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271815.110476:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6f7331800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788271815.110778:0:13018:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788271815.110783:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788271815.110787:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788271815.110793:0:13018:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788271815.110796:0:13018:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788271815.110869:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271815.110877:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271815.110883:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f706c 00000020:00000080:1.0:1788271815.110887:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6fe9bd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271815.111304:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6eda3c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788271815.111313:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab6ca68b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271815.111316:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ca68b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788271815.111321:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788271815.111525:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788271815.111530:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271815.111536:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788271815.111540:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ab6c57a8000) has no exports 00000020:00000080:1.0:1788271815.111545:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f7065 00000020:00000080:1.0:1788271815.111549:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ca68c800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788271815.111914:0:13018:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788271815.111926:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788271815.111929:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788271815.111933:0:13018:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788271815.111935:0:13018:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788271815.111965:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271815.111971:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271815.111995:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271815.112126:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6fe9bd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788271815.112133:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ca68c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788271815.112137:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6ca68d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788271815.112142:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab6ff6e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271815.112144:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ff6e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788271815.112147:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271815.112252:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271815.112257:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6c9e78000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788271815.112259:0:13018:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c9e78000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788271815.112264:0:13018:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271815.112379:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f1c 00000020:00000080:1.0:1788271815.112385:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ffc57000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788271815.112500:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788271815.112504:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271815.112508:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788271815.112511:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8ab6ffc60000) has no exports 00000020:00000080:1.0:1788271815.112530:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271815.112532:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788271815.112536:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f23 00000020:00000080:1.0:1788271815.112540:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ffc52800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271815.112836:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ffc57000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788271815.112841:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab6ffc51800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788271815.112843:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ffc51800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788271815.112847:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788271815.113094:0:13018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6c9170000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788271815.113099:0:13018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c9170000 3 00000020:01000004:1.0:1788271815.113102:0:13018:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab6c9170000 from lustre-MDT0000 00000020:00000080:1.0:1788271815.113125:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271815.113129:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788271815.113132:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ffc52000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788271815.113134:0:13018:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ffc52000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788271815.113140:0:13018:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788271815.113168:0:13018:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788271815.113172:0:13018:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788271815.113175:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788271815.113185:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271815.113189:0:13018:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788271815.113195:0:13018:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ab6c916a000 e92ad5e1-0f38-442e-8a6a-19627f637d27 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788271815.113201:0:13018:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8ab6e5923370) has exports, disconnecting them 00000020:00080000:1.0:1788271815.113205:0:13018:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ab6c916a000), last request at 1788271597 00000020:00000080:1.0:1788271815.113219:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6eba 00000020:00010000:1.0:1788271815.113224:0:13018:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab6c916a000: total 1 00000100:00080000:1.0:1788271815.113228:0:13018:0:(import.c:65:import_set_state_nolock()) ffff8ab6c9168000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788271815.113301:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ffc52800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788271815.115167:0:13018:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab6c916a000): rc 0 00000020:00080000:1.0:1788271815.115176:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8ab6e5923370) has no exports 00000100:00100000:1.0:1788271815.115245:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ab6cc118000:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1788271815.115336:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ab6cc118600:5832] 2 exiting: rc = 0 00000100:00100000:2.0:1788271815.115442:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ab6cc119a00:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1788271815.115542:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115550:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115556:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115562:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115571:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115576:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115582:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115588:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115594:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115600:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115606:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115612:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115618:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115624:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115630:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115635:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115641:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115647:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115652:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115670:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115677:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115701:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115706:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115712:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115718:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115724:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115730:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115735:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115740:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115744:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115749:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115754:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115760:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115765:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115771:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115776:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115781:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115787:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115793:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115798:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115803:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115808:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115814:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115820:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115826:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115831:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115836:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115841:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115846:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115851:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115856:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115862:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115868:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115874:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115879:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115885:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115897:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115902:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115908:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115914:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115919:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115924:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115930:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271815.115935:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1788271815.116495:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab6c916a000: total 0 00010000:00010000:0.0:1788271815.116547:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab6c916a000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788271815.116584:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2000/0xbeb05ca97b5f71ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f71e6 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116606:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3e00/0xbeb05ca97b5f6fd9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f6fd2 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116622:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d2400/0xbeb05ca97b5f7217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f7210 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116632:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7021d3200/0xbeb05ca97b5f71c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f71bc expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116643:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6ff375800/0xbeb05ca97b5f740f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f7408 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116677:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6c0030200/0xbeb05ca97b5f71df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f71d8 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116687:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024b400/0xbeb05ca97b5f741d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f7416 expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116699:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f71d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbeb05ca97b5f71ca expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.116709:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab6c916a000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788271815.116722:0:5825:0:(genops.c:885:class_export_put()) final put ffff8ab6c916a000/e92ad5e1-0f38-442e-8a6a-19627f637d27 00010000:00010000:0.0:1788271815.116743:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271815.116745:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271815.116747:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788271815.116796:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c916a000/e92ad5e1-0f38-442e-8a6a-19627f637d27 for MGS 00000020:00000080:2.0:1788271815.116849:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6c9168000 for MGS 20000000:01000000:1.0:1788271815.117729:0:13018:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788271815.117735:0:13018:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788271815.122348:0:13018:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6c6a4a5a0 - data ffff8ab6cc728438/ffff8ab6f77c5c00 00000020:01000000:1.0:1788271815.122514:0:13018:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6cbf1cea0 - data ffff8ab6d6fd90d8/ffff8ab6e59cf400 00000020:00000080:1.0:1788271815.123234:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6ea5 00000020:00000080:1.0:1788271815.123244:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6c31be000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788271815.123298:0:13018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6c9170000 from MGS, refs=2 00000020:01000004:1.0:1788271815.123302:0:13018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c9170000 2 00000020:01000004:1.0:1788271815.123305:0:13018:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab6c9170000 from MGS 00000020:00000080:1.0:1788271815.123327:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271815.123333:0:13018:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788271815.123336:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6c31bc000/MGS 00000020:00000080:1.0:1788271815.123338:0:13018:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c31bc000/MGS for MGS 00000020:01000000:1.0:1788271815.123345:0:13018:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788271815.123404:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788271815.123408:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271815.123441:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788271815.123448:0:13018:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ab6fe9ba800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788271815.123454:0:13018:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8ab6e59219b8) has exports, disconnecting them 00000020:00080000:1.0:1788271815.123458:0:13018:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ab6fe9ba800), last request at 1788271599 00000020:00000080:1.0:1788271815.123462:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6f70 00000020:00080000:1.0:1788271815.123470:0:13018:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab6fe9ba800): rc 0 00000020:00000080:1.0:1788271815.123475:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6fe9ba800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788271815.123976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c31be000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788271815.124936:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6fe9ba800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788271815.125883:0:13018:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788271815.125889:0:13018:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271815.125893:0:13018:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788271815.125899:0:13018:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788271815.126107:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271815.126116:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788271815.126124:0:13018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c9170000 1 00000020:00000080:0.0:1788271815.126129:0:13018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6e97 00000020:00000080:0.0:1788271815.126137:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6c31bd800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788271815.126143:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788271815.126148:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271815.126152:0:13018:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788271815.126155:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ab6de9e3370) has no exports 00000020:00000080:2.0:1788271815.126848:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6fe9b8000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788271815.126858:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab6fe9b9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788271815.126860:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6fe9b9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788271815.126869:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788271815.126926:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c31bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788271815.145382:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271815.145399:0:13018:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788271815.145406:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6ca6ba000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271815.145434:0:13018:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ca6ba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788271815.145446:0:13018:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788271815.145591:0:13018:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab6c9177000 00000020:01000000:2.0:1788271815.145615:0:13018:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788271815.145619:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271815.145624:0:13018:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788271815.145628:0:13018:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ab6de9e19b8) has no exports 00000100:00100000:2.0:1788271815.145711:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ab6e59d9800:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788271815.147987:0:8302:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ab6ee0b4000:8302] 3 exiting: rc = 0 00000100:00100000:0.0:1788271815.148095:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ab6c8203e00:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1788271815.150462:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ab6e59d9c00:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1788271815.150872:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150881:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150889:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150894:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150900:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150906:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150911:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150917:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150922:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150927:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150933:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150939:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150944:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150949:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150954:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150970:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150976:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150981:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150987:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.150992:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151008:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151019:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151025:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151029:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151034:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151039:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151045:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151050:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151055:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151060:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151066:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151071:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151077:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151083:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151089:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151094:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151100:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151105:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151110:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151114:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151120:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151124:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151130:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151135:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151141:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151145:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151150:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151155:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151162:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151167:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151181:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151186:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151191:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151196:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151201:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151206:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151212:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151218:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151223:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151229:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151235:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151239:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151244:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.151249:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157101:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ab6c8330e00:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788271815.157395:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ab6c8330400:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1788271815.157815:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157823:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157829:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157835:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157841:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157846:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157853:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157858:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157864:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157870:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157876:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157882:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157888:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157892:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157897:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157902:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157906:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157911:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157917:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157922:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157926:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157932:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157937:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157942:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157946:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157951:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157956:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157961:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157966:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157970:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157975:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.157994:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158037:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158045:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158050:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158055:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158060:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158066:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158071:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158076:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158081:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158087:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158092:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158097:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158102:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158107:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158112:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158117:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158123:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158128:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158134:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158139:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158144:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158149:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158154:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158159:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158164:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158170:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158175:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158181:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158185:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158190:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158196:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.158205:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.158728:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ab6cc179200:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1788271815.159622:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ab6cc178a00:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1788271815.160527:0:11960:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8ab6f756ae00:11960] 2 exiting: rc = 0 00000100:00100000:2.0:1788271815.160640:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160648:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160667:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160675:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160680:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160686:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160692:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160697:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160703:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160709:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160729:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160738:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160746:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160751:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160757:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160763:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160769:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160775:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160781:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160799:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160805:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160811:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160831:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160837:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160843:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160849:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160856:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160862:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160868:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160873:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160879:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160885:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160891:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160898:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160920:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160928:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160934:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160939:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160945:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160950:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160956:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160962:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160967:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160973:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160978:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160983:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.160999:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161005:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161021:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161028:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161035:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161041:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161045:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161052:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161064:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161069:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161083:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161089:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161110:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161116:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161122:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161127:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161136:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.161143:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174812:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ab6cc178200:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788271815.174906:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ab6cc179000:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788271815.174954:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174962:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174967:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174972:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174977:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174982:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174987:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174992:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.174996:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175001:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175005:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175010:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175168:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175173:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175178:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175183:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175188:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175192:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175197:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175201:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175206:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175212:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175218:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175237:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175242:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175247:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175251:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175256:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175262:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175267:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175272:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175276:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175281:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175286:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175292:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175297:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175302:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175306:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175311:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175315:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175321:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175325:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175331:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175335:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175341:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175346:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175351:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175355:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175359:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175364:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175369:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175374:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175379:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175384:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175388:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175393:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175398:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175402:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175750:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175758:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175764:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175770:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175777:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.175783:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.176260:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ab6cc179a00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1788271815.176338:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ab6cc178000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1788271815.176496:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176503:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176508:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176512:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176516:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176521:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176526:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176531:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176536:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176541:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176546:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176551:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176556:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176560:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176566:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176571:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176576:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176582:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176587:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176592:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176596:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176602:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176607:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176612:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176617:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176622:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176627:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176631:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176635:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176648:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176664:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176670:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176676:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176681:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176686:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176690:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176695:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176700:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176705:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176710:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176715:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176719:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176725:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176729:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176734:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176739:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176744:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176748:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176753:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176760:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176766:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176771:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176776:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176781:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176786:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176791:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176796:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176800:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176804:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176809:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176814:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176819:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176823:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.176827:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.177801:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ab6fd93c800:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1788271815.177929:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ab6cc179e00:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1788271815.178087:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178096:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178101:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178107:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178113:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178118:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178124:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178130:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178135:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178140:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178146:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178151:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178156:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178161:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178167:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178172:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178177:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178182:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178189:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178193:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178199:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178205:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178309:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178317:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178323:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178328:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178333:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178339:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178344:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178349:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178354:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178359:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178364:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178370:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178388:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178393:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178398:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178404:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178409:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178445:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178451:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178457:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178461:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178466:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178473:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178480:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178486:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178491:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178496:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178502:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178507:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178511:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178515:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178520:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178525:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178530:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178534:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178539:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178543:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178548:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178553:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178557:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178562:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.178566:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271815.179084:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ab6fd93cc00:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1788271815.179348:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ab6fd93d200:5852] 2 exiting: rc = 0 00000100:00100000:0.0:1788271815.179870:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ab6fd93ca00:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1788271815.180301:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180310:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180317:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180322:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180328:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180345:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180351:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180356:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180373:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180380:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180386:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180391:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180397:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180403:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180409:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180443:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180452:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180457:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180463:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180468:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180477:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180482:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180488:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180494:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180500:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180506:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180510:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180516:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180522:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180528:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180533:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180539:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180559:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180566:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180572:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180578:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180583:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180588:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180594:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180600:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180613:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180619:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180626:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180631:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180636:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180643:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180649:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180664:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180672:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180677:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180683:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180688:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180693:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180699:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180704:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180709:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180728:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180734:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180740:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180746:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180751:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180756:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180762:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271815.180767:0:13018:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788271815.185477:0:13018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271815.185495:0:13018:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788271815.185502:0:13018:0:(genops.c:885:class_export_put()) final put ffff8ab6c9e7f800/MDS_uuid 00000020:00000080:2.0:1788271815.185506:0:13018:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c9e7f800/MDS_uuid for MDS 00000020:01000000:2.0:1788271815.185515:0:13018:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788271815.185644:0:13018:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788271815.666588:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271816.693637:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271817.238773:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788271817.238784:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ab6ee234000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788271817.239220:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ee234000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788271817.239343:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6ee236800 for lustre-OST0001 00010000:00010000:3.0:1788271817.716309:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788271817.725361:0:13170:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788271817.745580:0:13170:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788271817.745669:0:13170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.745688:0:13170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.745696:0:13170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.745704:0:13170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.745731:0:13170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788271817.745748:0:13170:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788271817.745778:0:13170:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271817.745784:0:13170:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788271817.745791:0:13170:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788271817.745825:0:13170:0:(import.c:65:import_set_state_nolock()) ffff8ab6c614d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788271817.746140:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875138586951168:0@lo:39:umount.0 00000400:00000100:2.0:1788271817.746226:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138586951168 offset 0 length 224: 4 00010000:00010000:1.0:1788271817.747293:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271817.747324:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.747336:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d2200 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271817.747340:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.747351:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271817.747359:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271817.747365:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788271817.747368:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788271817.747372:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788271817.751247:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.751270:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271817.751319:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.751328:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d2200/0xbeb05ca97b5f71d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbeb05ca97b5f71df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.751350:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271817.751352:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271817.751355:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271817.752362:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586951296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271817.752491:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271817.752649:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586951296 00000100:00100000:1.0:1788271817.752661:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586951296 00000100:00100000:1.0:1788271817.752863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788271817.752891:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3281:x1875138586951296:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788271817.752899:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788271817 with bad export cookie 13740584346096463546 00000100:00100000:1.0:1788271817.769985:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3281:x1875138586951296:12345-0@lo:103:ldlm_bl.0 Request processed in 17081us (17480us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788271817.770005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788271817.770499:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788271817.770507:0:3281:0:(import.c:65:import_set_state_nolock()) ffff8ab6c9168800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788271817.770530:0:3281:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788271817.785315:0:3281:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.101@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788271817.785323:0:3281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788271817.785337:0:3281:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6eda28a80 x1875138586951296/t0(0) o103->MGC192.168.201.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788271833 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788271817.785355:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788271817.785358:0:3281:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788271817.785360:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788271817.785364:0:3281:0:(import.c:65:import_set_state_nolock()) ffff8ab6c9168800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271817.785370:0:3281:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 160 00000100:00080000:3.0:1788271817.785380:0:3281:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import ffff8ab6c9168800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271817.794777:0:3281:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ffad3480 x1875138586951424/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271817.794863:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e92ad5e1-0f38-442e-8a6a-19627f637d27:3281:1875138586951296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271817.795165:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e92ad5e1-0f38-442e-8a6a-19627f637d27:3277:1875138586951424:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1788271817.796381:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875138586951424 offset 0 length 520: 4 00010000:00010000:0.0:1788271818.738717:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788271818.773318:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788271818.773333:0:6722:0:(genops.c:885:class_export_put()) final put ffff8ab6fe9ba000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271818.773580:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6fe9ba000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788271818.773748:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6fe9b8800 for lustre-OST0000 00010000:00010000:1.0:1788271819.762837:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271819.763445:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788271819.763454:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788271819.763630:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586951552:0@lo:400:kworker.0 00000400:00000100:0.0:1788271819.763707:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138586951552 offset 0 length 224: 4 00010000:00010000:0.0:1788271820.786802:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271821.811397:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271822.770541:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788271822.770553:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788271822.770740:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586951680:0@lo:400:kworker.0 00000400:00000100:1.0:1788271822.770809:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138586951680 offset 0 length 224: 4 00010000:00010000:0.0:1788271822.837181:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271823.858953:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271824.882802:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271825.906666:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271826.931222:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271827.954699:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271817/real 1788271817] req@ffff8ab6ffad3480 x1875138586951424/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788271827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271827.954760:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6ffad3480 x1875138586951424/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788271827 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271827.954780:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271817/real 1788271817] req@ffff8ab6f7b3dc00 x1875138586951168/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271827.954792:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6f7b3dc00 x1875138586951168/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271827 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271827.954808:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c9168800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271827.954817:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788271827.954821:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e92ad5e1-0f38-442e-8a6a-19627f637d27:3277:1875138586951424:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788271827.954827:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c614d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788271827.954846:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875138586951168:0@lo:39:umount.0 00000100:00080000:0.0:1788271827.954884:0:13170:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271827.954888:0:13170:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788271827.954893:0:13170:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788271827.955084:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271827.955090:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788271827.955092:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab6c9168800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271827.955097:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 380 00000100:00080000:1.0:1788271827.955102:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788271827.955107:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import ffff8ab6c9168800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1788271827.955137:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6eda28a80 x1875138586951808/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788271827.955216:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586951936:0@lo:400:kworker.0 00000400:00000100:1.0:1788271827.955262:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138586951936 offset 0 length 224: 4 00010000:00010000:1.0:1788271827.955351:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271827.955530:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e92ad5e1-0f38-442e-8a6a-19627f637d27:3277:1875138586951808:0@lo:250:kworker.0 00000400:00000100:2.0:1788271827.955550:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875138586951808 offset 0 length 520: 4 00010000:00010000:0.0:1788271827.956032:0:13170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956045:0:13170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956053:0:13170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956060:0:13170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956085:0:13170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271827.956092:0:13170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956098:0:13170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956105:0:13170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956111:0:13170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271827.956140:0:13170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788271827.956145:0:13170:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788271827.956166:0:13170:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788271827.956169:0:13170:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788271827.956174:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271827.956179:0:13170:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788271827.956183:0:13170:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ab6ffc64d28) has no exports 00000020:00080000:0.0:1788271827.956207:0:13170:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ab6ffc64d28) has no exports 00010000:00010000:1.0:1788271827.956644:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271827.956652:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956682:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d3a00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271827.956686:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956695:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271827.956703:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271827.956709:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788271827.956711:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788271827.956714:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788271827.956726:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab6c9168800 00010000:00010000:1.0:1788271827.956730:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956755:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3a00/0xbeb05ca97b5f71e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f71ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956770:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271827.956774:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956780:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271827.956783:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956789:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271827.956802:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271827.956807:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788271827.956809:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788271827.956810:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788271827.956816:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab6c9168800 00010000:00010000:1.0:1788271827.956819:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956826:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab70024a000/0xbeb05ca97b5f7416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f741d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271827.956836:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271827.956843:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271827.956845:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271827.956877:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788271827.959690:0:13170:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6c6184660 - data ffff8ab6f7e90a20/ffff8ab6fef97400 00000020:01000000:0.0:1788271827.959830:0:13170:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6c61ee1e0 - data ffff8ab6d6f33000/ffff8ab6f7961800 00100000:10000000:0.0:1788271827.968242:0:13170:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788271828.020169:0:13170:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6ff5 00000020:00000080:0.0:1788271828.020179:0:13170:0:(genops.c:885:class_export_put()) final put ffff8ab6f757f800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788271828.020241:0:13170:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6c914a800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788271828.020245:0:13170:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c914a800 2 00000020:01000004:0.0:1788271828.020249:0:13170:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab6c914a800 from lustre-OST0000 00000020:00000080:0.0:1788271828.020273:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271828.020282:0:13170:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788271828.020286:0:13170:0:(genops.c:885:class_export_put()) final put ffff8ab6f3aa0800/lustre-OST0000_UUID 00000020:00000080:0.0:1788271828.020289:0:13170:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6f3aa0800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788271828.020296:0:13170:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788271828.020345:0:13170:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788271828.020350:0:13170:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788271828.020355:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271828.020360:0:13170:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788271828.020367:0:13170:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ab6ff6ef800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788271828.020373:0:13170:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8ab6e59d3370) has exports, disconnecting them 00000020:00080000:0.0:1788271828.020377:0:13170:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ab6ff6ef800), last request at 1788271619 00000020:00000080:0.0:1788271828.020396:0:13170:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f701f 00000020:00080000:0.0:1788271828.020406:0:13170:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab6ff6ef800): rc 0 00000020:00000080:0.0:1788271828.020410:0:13170:0:(genops.c:885:class_export_put()) final put ffff8ab6ff6ef800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788271828.023776:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6f757f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788271828.025794:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ff6ef800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788271828.026504:0:13170:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788271828.026510:0:13170:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271828.026514:0:13170:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788271828.026519:0:13170:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788271828.026700:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271828.026709:0:13170:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788271828.026717:0:13170:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c914a800 1 00000020:00000080:0.0:1788271828.026724:0:13170:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6faf 00000020:00000080:0.0:1788271828.026732:0:13170:0:(genops.c:885:class_export_put()) final put ffff8ab6ed9ed800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788271828.026737:0:13170:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788271828.026742:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271828.026746:0:13170:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788271828.026750:0:13170:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8ab6c57acd28) has no exports 00000020:00000080:3.0:1788271828.026825:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6c614d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788271828.026832:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab6ca4be000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788271828.026835:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ca4be000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788271828.026839:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788271828.027017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ed9ed800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788271828.052646:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271828.052672:0:13170:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788271828.052677:0:13170:0:(genops.c:885:class_export_put()) final put ffff8ab6c914e000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788271828.052681:0:13170:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c914e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788271828.052691:0:13170:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788271828.052836:0:13170:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab6c9148000 00000020:02000400:0.0:1788271828.052883:0:13170:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788271828.982626:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271830.003836:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788271830.472251:0:13324:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788271830.483895:0:13324:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788271830.484144:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271830.484159:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271830.484168:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271830.484182:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271830.484213:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788271830.484219:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788271830.484244:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788271830.484256:0:13324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6ffad1880 x1875138586951552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271835 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271830.484276:0:13324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6ffad0700 x1875138586951680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271830.484297:0:13324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6eda2ad80 x1875138586951936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271830.484310:0:13324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788271830.484317:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788271830.484346:0:13324:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca68a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788271830.484470:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586951552:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.484529:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586951680:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.484558:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875138586951936:0@lo:400:kworker.0 00010000:00010000:2.0:1788271830.484702:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271830.484710:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271830.484718:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024aa00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271830.484722:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271830.484741:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271830.484749:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271830.484756:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788271830.484759:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788271830.484762:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788271830.484775:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab6c9168800 00010000:00010000:2.0:1788271830.484778:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271830.484784:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f71bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f71c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271830.484797:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271830.484799:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271830.484807:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271830.484823:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875138586952064:0@lo:39:umount.0 00000400:00000100:2.0:1788271830.484866:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138586952064 offset 0 length 224: 4 00010000:00010000:0.0:1788271831.028257:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271832.050805:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271833.075042:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271833.075051:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788271833.075208:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271834.101213:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271835.123193:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271836.147019:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271837.172964:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271838.197635:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788271838.197645:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788271838.199264:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271839.218879:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271840.244353:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271840.693776:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271830/real 1788271830] req@ffff8ab6f79b6680 x1875138586952064/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271840 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271840.693819:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6f79b6680 x1875138586952064/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271840 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788271840.693838:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ca68a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788271840.693858:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875138586952064:0@lo:39:umount.0 00000100:00080000:3.0:1788271840.693943:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788271840.693947:0:13324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788271840.693952:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788271840.694942:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.694960:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.694967:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.694991:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.695018:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271840.695026:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.695032:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.695038:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.695044:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.695316:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788271840.695323:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788271840.695350:0:13324:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788271840.695355:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788271840.695359:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271840.695365:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788271840.695371:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ab6c9f0b370) has no exports 00000020:00080000:3.0:1788271840.695400:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ab6c9f0b370) has no exports 00000020:01000000:3.0:1788271840.697124:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6c61840c0 - data ffff8ab6f7e87360/ffff8ab6fef96400 00010000:00010000:1.0:1788271840.702137:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271840.702151:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702164:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7021d3c00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271840.702168:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702179:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271840.702205:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271840.702222:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788271840.702225:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788271840.702228:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788271840.702250:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab6c9168800 00010000:00010000:1.0:1788271840.702254:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702261:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab7021d3c00/0xbeb05ca97b5f71ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f71d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702276:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271840.702280:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702285:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6400 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271840.702288:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702294:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271840.702300:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271840.702305:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788271840.702307:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788271840.702314:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788271840.702320:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab6c9168800 00010000:00010000:1.0:1788271840.702324:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702330:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6400/0xbeb05ca97b5f7408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f740f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.702343:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271840.702345:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271840.702346:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788271840.702716:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6c9fc5120 - data ffff8ab6de75e798/ffff8ab6ee219c00 00010000:00010000:0.0:1788271840.705638:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788271840.711888:0:13324:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788271840.757809:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f70c0 00000020:00000080:3.0:1788271840.757833:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6ee230800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788271840.757850:0:13324:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6ee935800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788271840.757853:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6ee935800 2 00000020:01000004:3.0:1788271840.757856:0:13324:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab6ee935800 from lustre-OST0001 00000020:00000080:3.0:1788271840.757880:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271840.757890:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788271840.757893:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6f3aa2000/lustre-OST0001_UUID 00000020:00000080:3.0:1788271840.757895:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6f3aa2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788271840.757901:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788271840.757999:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e92ad5e1-0f38-442e-8a6a-19627f637d27->MGS 00010000:00010000:3.0:1788271840.758013:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f6fd9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271840.758026:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f6fd9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271840.758032:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788271840.758034:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788271840.758038:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788271840.758051:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab6c9168800 00010000:00010000:3.0:1788271840.758055:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c148ba00/0xbeb05ca97b5f6fd2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f6fd9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.758070:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbeb05ca97b5f7217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271840.758077:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbeb05ca97b5f7217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271840.758082:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271840.758085:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788271840.758086:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788271840.758101:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab6c9168800 00010000:00010000:3.0:1788271840.758104:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6c0031a00/0xbeb05ca97b5f7210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbeb05ca97b5f7217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788271840.758121:0:13324:0:(import.c:65:import_set_state_nolock()) ffff8ab6c9168800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788271840.758124:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788271840.758126:0:13324:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788271840.758127:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788271840.758131:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788271840.758143:0:13324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6eda28a80 x1875138586951808/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788271842 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788271840.758170:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788271840.758173:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788271840.758371:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e92ad5e1-0f38-442e-8a6a-19627f637d27:3277:1875138586951808:0@lo:250:kworker.0 10000000:01000000:3.0:1788271840.758533:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788271840.758541:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f6eb3 00000020:00000080:3.0:1788271840.758545:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6c9e7b000/e92ad5e1-0f38-442e-8a6a-19627f637d27 00000020:01000000:3.0:1788271840.758608:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.101@tcp (flags='') 00000020:00000080:3.0:1788271840.758613:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271840.758619:0:13324:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788271840.758622:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8ab6e59d0000) has no exports 10000000:01000000:1.0:1788271840.758863:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788271840.759022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ee230800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788271840.759035:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c9e7b000/e92ad5e1-0f38-442e-8a6a-19627f637d27 for MGC192.168.201.101@tcp 10000000:01000000:3.0:1788271840.759855:0:13324:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.101@tcp: client import never connected 00000100:00080000:3.0:1788271840.759861:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788271840.759865:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788271840.759868:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788271840.759871:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788271840.759911:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271840.759919:0:13324:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.101@tcp (uuid e92ad5e1-0f38-442e-8a6a-19627f637d27) 00000020:01000000:3.0:1788271840.759926:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788271840.759930:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271840.759934:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788271840.759940:0:13324:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ab6ee937000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788271840.759945:0:13324:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8ab6c57ab370) has exports, disconnecting them 00000020:00080000:3.0:1788271840.759960:0:13324:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ab6ee937000), last request at 1788271637 00000020:00000080:3.0:1788271840.759965:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f70ea 00000020:00080000:3.0:1788271840.759977:0:13324:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab6ee937000): rc 0 00000020:00000080:3.0:1788271840.759981:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6ee937000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788271840.760731:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6c9168800 for MGC192.168.201.101@tcp 00000020:00000080:0.0:1788271840.760740:0:36:0:(genops.c:885:class_export_put()) final put ffff8ab6c916e000/e92ad5e1-0f38-442e-8a6a-19627f637d27 00000020:00000080:0.0:1788271840.760743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c916e000/e92ad5e1-0f38-442e-8a6a-19627f637d27 for MGC192.168.201.101@tcp 00000020:01000000:0.0:1788271840.760749:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.101@tcp (e92ad5e1-0f38-442e-8a6a-19627f637d27) 00000020:00000080:0.0:1788271840.760987:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ee937000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788271840.768535:0:13324:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788271840.768544:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271840.768548:0:13324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788271840.768563:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788271840.768649:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788271840.768762:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6ca68a000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788271840.768871:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788271840.769018:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ab6c61c9000:5821] 1 exiting: rc = 0 00000100:00100000:1.0:1788271840.769067:0:8505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8ab6edf17400:8505] 2 exiting: rc = 0 00000100:00100000:3.0:1788271840.827574:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ab6c5330000:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1788271840.827950:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.827959:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.828289:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ab6c6147200:5824] 2 exiting: rc = 0 00000100:00100000:3.0:1788271840.828383:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ab6c8ac3800:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1788271840.828723:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ab6c61c9a00:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1788271840.828780:0:8506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ab6cbfee400:8506] 3 exiting: rc = 0 00000100:00100000:0.0:1788271840.829165:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829182:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829189:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829195:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829201:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829215:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829222:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829227:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829233:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829241:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829247:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829252:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829258:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829263:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829270:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829276:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829283:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829289:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829294:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829299:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829304:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829309:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829315:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829320:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829325:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829342:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829348:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829354:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829359:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829364:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829369:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829384:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829390:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829395:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829401:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829406:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829455:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829461:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829466:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829681:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829687:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829693:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829699:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829704:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829709:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829715:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829721:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829726:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829731:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829736:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829742:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829747:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829752:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829757:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829762:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829767:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829773:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829778:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829783:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829789:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829794:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829798:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829803:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.829808:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788271840.830799:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271840.830807:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788271840.830812:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6ca68f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788271840.830866:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ca68f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788271840.830871:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788271840.830904:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6ee935800 1 00000020:00000080:1.0:1788271840.830909:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbeb05ca97b5f708f 00000020:00000080:1.0:1788271840.830915:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6ed9ed000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788271840.830927:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788271840.830931:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271840.830940:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788271840.830943:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ab6c9f08000) has no exports 00000020:00000080:0.0:1788271840.831027:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ed9ed000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788271840.851014:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271840.851029:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788271840.851035:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6c3187800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788271840.851039:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6c3187800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788271840.851766:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788271840.851945:0:13324:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab6c3184000 00000020:01000000:1.0:1788271840.851965:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788271840.851968:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271840.851973:0:13324:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788271840.851976:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8ab6ffc619b8) has no exports 00000020:00000080:1.0:1788271840.851994:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271840.852000:0:13324:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788271840.852003:0:13324:0:(genops.c:885:class_export_put()) final put ffff8ab6ed9ee000/OSS_uuid 00000020:00000080:1.0:1788271840.852005:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6ed9ee000/OSS_uuid for OSS 00000020:01000000:1.0:1788271840.852008:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788271840.852165:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788271840.852364:0:8463:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ab5c2640a00:8463] 3 exiting: rc = 0 00000100:00100000:2.0:1788271840.856212:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ab6ff218000:6700] 2 exiting: rc = 0 00000100:00100000:2.0:1788271840.856349:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ab6cab40c00:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1788271840.856394:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ab6e582d000:6698] 1 exiting: rc = 0 00000100:00100000:1.0:1788271840.856934:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856943:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856948:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856954:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856958:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856964:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856968:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856973:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856977:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856982:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856986:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856991:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.856995:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857000:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857005:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857010:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857015:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857030:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857035:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857041:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857111:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857118:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857123:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857128:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857134:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857139:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857144:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857149:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857154:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857159:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857166:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857171:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857175:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857182:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857187:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857192:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857199:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857214:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857220:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857226:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857231:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857237:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857243:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857250:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857255:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857260:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857265:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857270:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857275:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857280:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857285:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857289:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857300:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857305:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857309:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857319:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857324:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857328:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857333:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857337:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857341:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857346:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857351:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.857355:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.859658:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ab6c5151000:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1788271840.859745:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ab6c5150e00:6702] 1 exiting: rc = 0 00000100:00100000:1.0:1788271840.860032:0:9404:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8ab6f77d0c00:9404] 2 exiting: rc = 0 00000100:00100000:3.0:1788271840.860408:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860621:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860626:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860631:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860636:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860640:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860645:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860650:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860654:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860658:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860663:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860668:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860673:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860678:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860684:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860689:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860694:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860699:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860704:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860709:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860714:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860719:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860724:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860730:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860747:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860752:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860757:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860762:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860766:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860771:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860777:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860782:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860787:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860791:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860796:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860801:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860805:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860810:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860870:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860879:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860884:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860888:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860891:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860895:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860898:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860902:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860905:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860909:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860912:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860916:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860919:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860923:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860926:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860929:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860933:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860936:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860938:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860941:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860944:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860953:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860956:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860959:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860964:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.860968:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.862318:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ab6ff218200:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1788271840.862973:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ab6ff14e800:6705] 2 exiting: rc = 0 00000100:00100000:3.0:1788271840.863270:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ab6ff219000:6704] 1 exiting: rc = 0 00000100:00100000:3.0:1788271840.863326:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863339:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863344:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863350:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863355:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863361:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863367:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863383:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863390:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863403:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863409:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863625:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863630:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863635:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863641:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863646:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863651:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863657:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863663:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863669:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863675:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863680:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863686:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863692:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863697:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863702:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863708:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863714:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863718:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863737:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863742:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863747:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863754:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863774:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863781:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863786:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863792:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863797:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863804:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863810:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863872:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863879:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863884:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863890:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863895:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863901:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863907:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863914:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863919:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863925:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863931:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863936:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863942:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863947:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863952:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863957:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863963:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863968:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863973:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863990:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.863997:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.864002:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.864008:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271840.864013:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.870905:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ab6ff14f200:6706] 0 exiting: rc = 1 00000100:00100000:3.0:1788271840.871146:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ab6c89f6800:6707] 1 exiting: rc = 0 00000100:00100000:0.0:1788271840.871242:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871268:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871274:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871293:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871298:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871303:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871308:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871313:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871317:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871322:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871326:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871331:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871335:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871340:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871345:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871349:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871353:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871358:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871362:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871367:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871383:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871407:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871619:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871642:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871646:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871650:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871654:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871659:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871665:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871671:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871677:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871681:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871687:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871693:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871698:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871704:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871709:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871714:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871727:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871733:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871738:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871745:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871751:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871756:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871762:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871768:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871774:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871780:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871786:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871791:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871796:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871802:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871807:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871872:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871895:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871900:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871906:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871911:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871916:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871921:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871926:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871931:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871935:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.871940:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271840.873174:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ab7015f5000:6709] 1 exiting: rc = 0 00000100:00100000:3.0:1788271840.873326:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ab7015f5600:6708] 0 exiting: rc = 1 00000100:00100000:0.0:1788271840.873477:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873498:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873513:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873536:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873541:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873658:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873667:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873673:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873679:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873696:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873701:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873707:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873712:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873718:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873739:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873746:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873753:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873758:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873764:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873771:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873777:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873782:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873788:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873794:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873799:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873805:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873834:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873841:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873847:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873853:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873859:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873865:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873870:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873876:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873882:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873889:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873894:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873900:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873932:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873959:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.873988:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874009:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874015:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874020:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874031:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874036:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874042:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874170:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874177:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874183:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874199:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874214:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874220:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874227:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874234:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874240:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874245:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874249:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874255:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874260:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874266:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874272:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874278:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271840.874284:0:13324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788271840.887802:0:13324:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788271856.510622:0:13939:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788271864.309516:0:14400:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788271864.309523:0:14400:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788271864.312095:0:14400:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab6f73f3800 00000020:01000004:0.0:1788271864.312120:0:14400:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788271864.312130:0:14400:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788271864.312145:0:14400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ab6e59d0000) 00000020:00000080:0.0:1788271864.312165:0:14400:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788271864.382355:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788271864.384185:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788271864.384637:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 553: rc = 0 00100000:10000000:3.0:1788271864.384737:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 553: rc = 0 00100000:10000000:3.0:1788271864.390390:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788271864.392896:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 553: rc = 0 00100000:10000000:3.0:1788271864.393208:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 553: rc = 0 00100000:10000000:3.0:1788271864.393305:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 553: rc = 0 00100000:10000000:3.0:1788271864.393401:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 553: rc = 0 00100000:10000000:3.0:1788271864.395094:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 555: rc = 0 00100000:10000000:3.0:1788271864.397742:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 761: rc = 0 00100000:10000000:3.0:1788271864.397881:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 761: rc = 0 00100000:10000000:3.0:1788271864.398779:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 559: rc = 0 00100000:10000000:3.0:1788271864.399651:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 559: rc = 0 00100000:10000000:3.0:1788271864.399929:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 559: rc = 0 00100000:10000000:3.0:1788271864.400287:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 559: rc = 0 00100000:10000000:3.0:1788271864.400895:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 559: rc = 0 00100000:10000000:3.0:1788271864.401307:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 559: rc = 0 00100000:10000000:3.0:1788271864.401679:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 559: rc = 0 00100000:10000000:3.0:1788271864.403639:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 559: rc = 0 00100000:10000000:3.0:1788271864.403944:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 559: rc = 0 00100000:10000000:3.0:1788271864.405597:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 559: rc = 0 00100000:10000000:3.0:1788271864.405926:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 559: rc = 0 00100000:10000000:3.0:1788271864.406215:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 559: rc = 0 00100000:10000000:3.0:1788271864.406697:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 170: rc = 0 00100000:10000000:3.0:1788271864.406969:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 170: rc = 0 00100000:10000000:3.0:1788271864.407250:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 170: rc = 0 00100000:10000000:3.0:1788271864.407538:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 170: rc = 0 00100000:10000000:3.0:1788271864.407777:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 170: rc = 0 00100000:10000000:2.0:1788271864.418110:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 170: rc = 0 00100000:10000000:2.0:1788271864.418521:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 170: rc = 0 00100000:10000000:2.0:1788271864.418786:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 170: rc = 0 00100000:10000000:2.0:1788271864.423086:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 170: rc = 0 00100000:10000000:2.0:1788271864.423464:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 170: rc = 0 00100000:10000000:2.0:1788271864.423729:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 170: rc = 0 00100000:10000000:2.0:1788271864.429659:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 170: rc = 0 00100000:10000000:2.0:1788271864.430159:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 170: rc = 0 00100000:10000000:2.0:1788271864.430640:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 170: rc = 0 00100000:10000000:2.0:1788271864.430911:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 170: rc = 0 00100000:10000000:2.0:1788271864.431357:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 170: rc = 0 00100000:10000000:2.0:1788271864.431626:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 170: rc = 0 00100000:10000000:2.0:1788271864.431892:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 170: rc = 0 00100000:10000000:2.0:1788271864.432164:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 170: rc = 0 00100000:10000000:2.0:1788271864.432454:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 170: rc = 0 00100000:10000000:2.0:1788271864.432717:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 170: rc = 0 00100000:10000000:2.0:1788271864.434647:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 170: rc = 0 00100000:10000000:2.0:1788271864.434938:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 170: rc = 0 00100000:10000000:2.0:1788271864.435224:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 170: rc = 0 00100000:10000000:2.0:1788271864.435657:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 170: rc = 0 00100000:10000000:2.0:1788271864.435927:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 170: rc = 0 00100000:10000000:2.0:1788271864.436502:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 170: rc = 0 00100000:10000000:2.0:1788271864.436777:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 170: rc = 0 00100000:10000000:2.0:1788271864.438838:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 170: rc = 0 00100000:10000000:2.0:1788271864.443275:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 170: rc = 0 00100000:10000000:2.0:1788271864.443589:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 170: rc = 0 00100000:10000000:2.0:1788271864.443858:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 170: rc = 0 00100000:10000000:2.0:1788271864.444241:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 159: rc = 0 00100000:10000000:2.0:1788271864.444767:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788271864.444942:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 762: rc = 0 00100000:10000000:2.0:1788271864.445143:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788271864.445213:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 762: rc = 0 00100000:10000000:2.0:1788271864.445392:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788271864.445489:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 762: rc = 0 00100000:10000000:2.0:1788271864.451042:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788271864.451196:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 157: rc = 0 00100000:10000000:2.0:1788271864.454188:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788271864.454432:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 157: rc = 0 00100000:10000000:2.0:1788271864.454660:0:14400:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788271864.454726:0:14400:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 157: rc = 0 00000020:00000080:2.0:1788271864.455222:0:14400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788271864.455368:0:14400:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788271864.455380:0:14400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f81b4 00000020:01000004:2.0:1788271864.455389:0:14400:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788271864.455395:0:14400:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788271864.455400:0:14400:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab6f73f3800 from MGS 00000020:01000004:2.0:1788271864.455404:0:14400:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788271864.455516:0:14400:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ab6c9f099b8) 00000020:00000080:2.0:1788271864.455528:0:14400:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788271864.455587:0:14400:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6f73f3800 from MGS, refs=2 00080000:01000000:2.0:1788271864.455593:0:14400:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271864.455598:0:14400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f81c2 00000100:00100000:2.0:1788271864.455702:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788271864.456050:0:14400:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788271864.456058:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788271864.456510:0:14400:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788271864.456518:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788271864.457198:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271864.457529:0:14400:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788271864.457535:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788271864.462371:0:14400:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788271864.462386:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788271864.462825:0:14400:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788271864.462833:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788271864.466114:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271864.466119:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271864.466121:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271864.466631:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271864.466635:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271864.466637:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271864.467361:0:14400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788271864.476581:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788271864.490716:0:14400:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788271864.490736:0:14400:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788271864.490740:0:14400:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788271864.493354:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788271864.493583:0:14400:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788271864.493720:0:14400:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788271864.494520:0:14400:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788271864.495194:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271864.497907:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788271864.497921:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788271864.504238:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788271864.504251:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788271864.508141:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788271864.508154:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788271864.513088:0:14400:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788271864.513112:0:14400:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.101@tcp' 00000020:01000004:3.0:1788271864.513114:0:14400:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788271864.513148:0:14400:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.101@tcp (typ=mgc) 00000020:00000080:3.0:1788271864.513161:0:14400:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.101@tcp (ffff8ab6e5924d28) 00000020:00000080:3.0:1788271864.513178:0:14400:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788271864.513257:0:14400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6ced8c800@MGC192.168.201.101@tcp: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1788271864.513505:0:14400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.101@tcp-0 is initialized 00000040:01000000:3.0:1788271864.513512:0:14400:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788271864.513683:0:14414:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788271864.525252:0:14416:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788271864.525511:0:14400:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.101@tcp (uuid b79826ef-d055-4784-972d-a5e369371347) 00000020:00000080:3.0:1788271864.525551:0:14400:0:(genops.c:1385:class_connect()) connect: client b79826ef-d055-4784-972d-a5e369371347, cookie 0xbeb05ca97b5f81d0 00000100:00080000:3.0:1788271864.525564:0:14400:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271864.525571:0:14400:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import ffff8ab6ced8c800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1788271864.525606:0:14400:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6f79b5180 x1875138586952192/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271864.525639:0:14400:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b79826ef-d055-4784-972d-a5e369371347->MGS 00000100:00100000:0.0:1788271864.525751:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b79826ef-d055-4784-972d-a5e369371347:3277:1875138586952192:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788271864.525845:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788271864.525985:0:14400:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788271864.525991:0:14400:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788271864.526005:0:14400:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ab6e5920000) 00000020:00000080:3.0:1788271864.526020:0:14400:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788271864.534323:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586952192 00000100:00100000:1.0:1788271864.534338:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586952192 00000100:00100000:1.0:1788271864.534381:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271864.534390:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875138586952192:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788271864.534438:0:14410:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b79826ef-d055-4784-972d-a5e369371347@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:1.0:1788271864.534470:0:14410:0:(genops.c:1385:class_connect()) connect: client b79826ef-d055-4784-972d-a5e369371347, cookie 0xbeb05ca97b5f81de 00000100:00080000:1.0:1788271864.534645:0:14410:0:(import.c:65:import_set_state_nolock()) ffff8ab6c9e78000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271864.535808:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+5:3277:x1875138586952192:12345-0@lo:250:mount.lustre.0 Request processed in 1403us (9947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.535820:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271864.542141:0:3277:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788271864.542166:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.101@tcp: connect to target with instance 0 00000100:00080000:0.0:1788271864.542178:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788271864.542185:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788271864.542190:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ced8c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788271864.542194:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788271864.542208:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788271864.542218:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b79826ef-d055-4784-972d-a5e369371347:3277:1875138586952192:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788271864.547260:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271864.547479:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788271864.547486:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788271864.548786:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788271864.548807:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788271864.549292:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271864.549299:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788271864.552962:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271864.553240:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788271864.553246:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788271864.554120:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788271864.554130:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788271864.614398:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271864.614770:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788271864.614777:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788271864.616000:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788271864.616012:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788271864.617118:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271864.617512:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788271864.617519:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788271864.618137:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788271864.618146:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788271864.618893:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271864.619060:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788271864.619065:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788271864.619896:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788271864.619906:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788271864.620767:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271864.620935:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788271864.620940:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788271864.622056:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788271864.622066:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788271864.655114:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271864.657592:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788271864.657600:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788271864.659011:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788271864.659021:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788271864.660028:0:14400:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271864.660091:0:14400:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788271864.661063:0:14400:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788271864.661089:0:14400:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788271864.661097:0:14400:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788271864.661305:0:14400:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788271864.661349:0:14400:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788271864.661354:0:14400:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788271864.661356:0:14400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271864.661357:0:14400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271864.661358:0:14400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271864.661359:0:14400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271864.661361:0:14400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271864.661362:0:14400:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271864.661364:0:14400:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271864.661365:0:14400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271864.661367:0:14400:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271864.661369:0:14400:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788271864.661372:0:14400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271864.661373:0:14400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271864.661374:0:14400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271864.661376:0:14400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271864.661377:0:14400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271864.661378:0:14400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271864.661379:0:14400:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271864.661380:0:14400:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271864.661386:0:14400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271864.661387:0:14400:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271864.661683:0:14400:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788271864.661706:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788271864.661781:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271864.661875:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea45180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.662013:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586952320 00000100:00100000:1.0:1788271864.662020:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586952320 00000100:00100000:1.0:1788271864.662110:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271864.662121:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+5:14400:x1875138586952320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788271864.662172:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788271864.662175:0:14413:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788271864.662178:0:14413:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788271864.662535:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788271864.662922:0:14413:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788271864.664050:0:14435:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788271864.664056:0:14435:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788271864.664059:0:14435:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788271864.664089:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788271864.664388:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788271864.664400:0:14413:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788271864.675380:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952320:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788271864.675401:0:14400:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788271864.675405:0:14400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271864.675406:0:14400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271864.675408:0:14400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271864.675409:0:14400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271864.675410:0:14400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271864.675441:0:14400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271864.675443:0:14400:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271864.675445:0:14400:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271864.675447:0:14400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271864.675448:0:14400:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788271864.675471:0:14400:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab6f73f3800 from lustre-MDT0000 10000000:01000000:3.0:1788271864.675498:0:14400:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788271864.675501:0:14400:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788271864.675505:0:14400:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ab6e5924d28 10000000:01000000:3.0:1788271864.675509:0:14400:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788271864.675516:0:14400:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab6e5924d28 from 1 10000000:01000000:3.0:1788271864.675519:0:14400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788271864.675573:0:14400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271864.675584:0:14400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271864.675595:0:14400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271864.675689:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271864.675734:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.675766:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.675819:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+5:14400:x1875138586952320:12345-0@lo:253:mount.lustre.0 Request processed in 13108us (13446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.675830:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271864.675866:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586952448 00000100:00100000:1.0:1788271864.675874:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586952448 00000100:00100000:1.0:1788271864.675920:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271864.675929:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+5:14400:x1875138586952448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271864.675941:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271864.675955:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f81ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f81e5 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.675992:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f81ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f81e5 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.676002:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee7000/0xbeb05ca97b5f81ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f81e5 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.676012:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7000, rc 0) 00000100:00100000:1.0:1788271864.676044:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+6:14400:x1875138586952448:12345-0@lo:101:mount.lustre.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.676051:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271864.676123:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271864.676335:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271864.676344:0:14400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271864.676393:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271864.676497:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.676522:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.676571:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586952576 00000100:00100000:1.0:1788271864.676575:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586952576 00000100:00100000:1.0:1788271864.676702:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271864.676712:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+6:14400:x1875138586952576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271864.676944:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+6:14400:x1875138586952576:12345-0@lo:501:mount.lustre.0 Request processed in 234us (446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271864.676952:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271864.677017:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952576:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788271864.677045:0:14400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788271864.677056:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677065:0:14400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271864.677073:0:14400:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab6f73f3800 10000000:01000000:0.0:1788271864.677089:0:14400:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788271864.677094:0:14400:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab6f73f3800 10000000:01000000:0.0:1788271864.677097:0:14400:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788271864.677100:0:14400:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab6f73f3800 from 1 10000000:01000000:0.0:1788271864.677102:0:14400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788271864.677122:0:14400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375000/0xbeb05ca97b5f81f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677130:0:14400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375000/0xbeb05ca97b5f81f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677300:0:14400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375000/0xbeb05ca97b5f81f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271864.677317:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788271864.677350:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.677381:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586952704 00000100:00100000:0.0:1788271864.677385:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586952704 00000100:00100000:0.0:1788271864.677442:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271864.677450:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+6:14400:x1875138586952704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271864.677459:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271864.677471:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6ff375600/0xbeb05ca97b5f81fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f81f3 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677488:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ff375600/0xbeb05ca97b5f81fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f81f3 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677497:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6ff375600/0xbeb05ca97b5f81fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f81f3 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677506:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375600, rc 0) 00000100:00100000:0.0:1788271864.677532:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+7:14400:x1875138586952704:12345-0@lo:101:mount.lustre.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271864.677537:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271864.677561:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015fc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271864.677575:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271864.677586:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375000/0xbeb05ca97b5f81f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81fa expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677602:0:14400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375000/0xbeb05ca97b5f81f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f81fa expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271864.677913:0:14400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788271864.677964:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375000/0xbeb05ca97b5f81f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81fa expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.677973:0:14400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375000/0xbeb05ca97b5f81f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81fa expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271864.677980:0:14400:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788271864.677984:0:14400:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271864.677989:0:14400:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab6f73f3800 10000000:01000000:0.0:1788271864.677992:0:14400:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788271864.677994:0:14400:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788271864.677996:0:14400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788271864.678013:0:14400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374000/0xbeb05ca97b5f8201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.678021:0:14400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374000/0xbeb05ca97b5f8201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.678029:0:14400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374000/0xbeb05ca97b5f8201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271864.678042:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788271864.678068:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.678099:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015fc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.678166:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586952832 00000100:00100000:1.0:1788271864.678172:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586952832 00000100:00100000:1.0:1788271864.678203:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271864.678210:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+7:14400:x1875138586952832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271864.678219:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271864.678237:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f8208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f8201 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.678251:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f8208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8201 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.678272:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6a00/0xbeb05ca97b5f8208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8201 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.678279:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6a00, rc 0) 00000100:00100000:1.0:1788271864.678361:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+8:14400:x1875138586952832:12345-0@lo:101:mount.lustre.0 Request processed in 150us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.678367:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271864.678748:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271864.678761:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374000/0xbeb05ca97b5f8201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8208 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.678770:0:14400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374000/0xbeb05ca97b5f8201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8208 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271864.678829:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271864.678856:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.678918:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015fc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.678954:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586952960 00000100:00100000:1.0:1788271864.678959:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586952960 00000100:00100000:1.0:1788271864.679024:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271864.679031:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+8:14400:x1875138586952960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271864.679722:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+9:14400:x1875138586952960:12345-0@lo:501:mount.lustre.0 Request processed in 689us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.679730:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271864.679886:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586952960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271864.679924:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586953088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271864.679969:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.680035:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f78209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.680068:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586953088 00000100:00100000:1.0:1788271864.680072:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586953088 00000100:00100000:1.0:1788271864.680105:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271864.680113:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+9:14400:x1875138586953088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271864.680474:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+9:14400:x1875138586953088:12345-0@lo:503:mount.lustre.0 Request processed in 362us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.680481:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271864.680700:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586953088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271864.681341:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14436:1875138586953216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271864.681387:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.681578:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7820a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.681712:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586953216 00000100:00100000:1.0:1788271864.681717:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586953216 00000100:00100000:1.0:1788271864.681778:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271864.681797:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+9:14436:x1875138586953216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271864.682073:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+9:14436:x1875138586953216:12345-0@lo:502:llog_process_th.0 Request processed in 286us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.682087:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271864.682158:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14436:1875138586953216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271864.682183:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271864.682194:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.682197:0:14436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788271864.682202:0:14436:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788271864.682204:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788271864.682218:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ab6e59219b8) 00000020:00000080:3.0:1788271864.682247:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788271864.682253:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788271864.682325:0:14436:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788271864.682333:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f8216 00000020:00000080:3.0:1788271864.682569:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788271864.682573:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271864.682577:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.682578:0:14436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788271864.682582:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271864.682585:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.682586:0:14436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788271864.682590:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788271864.682596:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ab6e5923370) 00000020:00000080:3.0:1788271864.682606:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788271864.682623:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788271864.682625:0:14436:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788271864.682628:0:14436:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788271864.682633:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788271864.682683:0:14436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6f73f3800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788271864.682702:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ab6fee499b8) 00000020:00000080:3.0:1788271864.682715:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788271864.682764:0:14436:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788271864.682770:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f822b 00000020:00000080:3.0:1788271864.682880:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788271864.682886:0:14436:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788271864.682890:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbeb05ca97b5f8232 00080000:01000000:3.0:1788271864.682895:0:14436:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788271864.682899:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f8239 00010000:00010000:3.0:1788271864.796976:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788271864.797539:0:14436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788271864.797724:0:14436:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788271864.798262:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ab6fee4cd28) 00000020:00000080:3.0:1788271864.798281:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788271864.800159:0:14436:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788271864.800174:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f8247 00000020:00000080:2.0:1788271864.802571:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788271864.815162:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbeb05ca97b5f824e 00000020:00000080:2.0:1788271864.816432:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788271864.816449:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271864.816456:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271864.816458:0:14436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788271864.816463:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271864.816469:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271864.816471:0:14436:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788271864.816475:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788271864.816516:0:14436:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788271864.816535:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271864.816538:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271864.816539:0:14436:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788271864.816541:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788271864.816543:0:14436:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788271864.816544:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788271864.816545:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788271864.816547:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788271864.816549:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271864.816550:0:14436:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788271864.816552:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788271864.816555:0:14436:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788271864.816559:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271864.816560:0:14436:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788271864.816562:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788271864.816568:0:14436:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:2.0:1788271864.816605:0:14436:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788271864.816609:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271864.816625:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ab6c9f0cd28) 00000020:00000080:2.0:1788271864.816640:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788271864.816645:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788271864.816713:0:14436:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788271864.816718:0:14436:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788271864.816736:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f825c 00010000:00080000:2.0:1788271864.816776:0:14436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6ee0e9000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:2.0:1788271864.817005:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788271864.817391:0:14436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788271864.817462:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788271864.818398:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271864.818614:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788271864.818694:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788271864.826039:0:14440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788271864.826048:0:14440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788271864.827251:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788271864.827264:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788271864.827295:0:14436:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788271864.827310:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f8263 00000100:00080000:3.0:1788271864.827319:0:14436:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271864.827324:0:14436:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab6ee0e9000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1788271864.827357:0:14436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6f79b4e00 x1875138586953344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271864.827384:0:14436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788271864.827447:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586953344:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788271864.827464:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271864.827468:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.827470:0:14436:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788271864.827473:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788271864.827475:0:14436:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788271864.827485:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788271864.827487:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788271864.827489:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788271864.827491:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.827493:0:14436:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788271864.827495:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788271864.827499:0:14436:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000400:00000100:0.0:1788271864.827500:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138586953344 offset 0 length 520: 4 00000020:00000080:3.0:1788271864.827503:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.827504:0:14436:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788271864.827506:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788271864.827509:0:14436:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:3.0:1788271864.827528:0:14436:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788271864.827530:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788271864.827540:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ab6fee48000) 00000020:00000080:3.0:1788271864.827550:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788271864.827556:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788271864.827609:0:14436:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788271864.827615:0:14436:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788271864.827621:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbeb05ca97b5f8271 00010000:00080000:3.0:1788271864.827660:0:14436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6c3184000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.101@tcp at head 00000100:00100000:0.0:1788271864.827682:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586953472:0@lo:400:kworker.0 00000100:00100000:0.0:1788271864.827720:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271864.827950:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788271864.827981:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586953472 00000100:00100000:2.0:1788271864.827988:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586953472 00000100:00100000:2.0:1788271864.828062:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271864.828072:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+9:3281:x1875138586953472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271864.828137:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+9:3281:x1875138586953472:12345-0@lo:400:kworker.0 Request processed in 66us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271864.828145:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271864.828214:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586953472:0@lo:400:kworker.0 00000040:01000000:3.0:1788271864.828329:0:14436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788271864.828350:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788271864.828913:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271864.828981:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788271864.829041:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788271864.831845:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788271864.831853:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788271864.832730:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788271864.832744:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788271864.832776:0:14436:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788271864.832809:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f8278 00000100:00080000:3.0:1788271864.832828:0:14436:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271864.832834:0:14436:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab6c3184000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1788271864.832868:0:14436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6f79b4700 x1875138586953600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271864.832922:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586953600:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788271864.832979:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138586953600 offset 0 length 520: 4 00000100:00080000:3.0:1788271864.833037:0:14436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788271864.833093:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271864.833097:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.833099:0:14436:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788271864.833102:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271864.833106:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.833108:0:14436:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788271864.833110:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788271864.833112:0:14436:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788271864.833114:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271864.833116:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.833117:0:14436:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788271864.833120:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271864.833123:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.833124:0:14436:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788271864.833127:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788271864.833169:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14436:1875138586953728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271864.833219:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.833236:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.833266:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586953728 00000100:00100000:1.0:1788271864.833273:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586953728 00000100:00100000:1.0:1788271864.833314:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788271864.833324:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+9:14436:x1875138586953728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271864.833583:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+9:14436:x1875138586953728:12345-0@lo:502:llog_process_th.0 Request processed in 260us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.833591:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271864.835437:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14436:1875138586953728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271864.835480:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271864.835489:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.835491:0:14436:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788271864.835496:0:14436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788271864.835774:0:14400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788271864.835805:0:14400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788271864.835824:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374000/0xbeb05ca97b5f8201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8208 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.835836:0:14400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374000/0xbeb05ca97b5f8201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8208 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271864.835843:0:14400:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6f73f3800 from 1 10000000:01000000:1.0:1788271864.835846:0:14400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788271864.835891:0:14400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.835899:0:14400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.835908:0:14400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271864.835947:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586953856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788271864.836004:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271864.836048:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c31e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271864.836537:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586953856 00000100:00100000:3.0:1788271864.836545:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586953856 00000100:00100000:3.0:1788271864.836593:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271864.836601:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+9:14400:x1875138586953856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271864.836614:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271864.836628:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f827f expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271864.836650:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271864.836660:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271864.836668:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18a00, rc 0) 00000100:00100000:3.0:1788271864.836721:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+10:14400:x1875138586953856:12345-0@lo:101:mount.lustre.0 Request processed in 120us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271864.836729:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271864.836894:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586953856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271864.836910:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.836919:0:14400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271864.837495:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586953984:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788271864.837539:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271864.837562:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ccdc5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.837716:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586953984 00000100:00100000:1.0:1788271864.837721:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586953984 00000100:00100000:1.0:1788271864.837769:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271864.837775:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+10:14400:x1875138586953984:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788271864.837800:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788271864.837805:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788271864.837863:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+10:14400:x1875138586953984:12345-0@lo:256:mount.lustre.0 Request processed in 88us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.837870:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271864.838129:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586953984:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788271864.839002:0:14400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788271864.839030:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.839041:0:14400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271864.839049:0:14400:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6f73f3800 from 1 10000000:01000000:2.0:1788271864.839052:0:14400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271864.839089:0:14400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.839097:0:14400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.839108:0:14400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271864.839127:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271864.839176:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271864.839205:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ccdc5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.839350:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586954112 00000100:00100000:1.0:1788271864.839356:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586954112 00000100:00100000:1.0:1788271864.839402:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788271864.839426:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+10:14400:x1875138586954112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271864.839438:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271864.839450:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f828d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.839471:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.839482:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.839490:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6600, rc 0) 00000100:00100000:1.0:1788271864.839534:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:14400:x1875138586954112:12345-0@lo:101:mount.lustre.0 Request processed in 123us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.839540:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271864.839712:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271864.839881:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.839891:0:14400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271864.839948:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271864.839974:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271864.840047:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ccdc5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271864.844272:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586954240 00000100:00100000:0.0:1788271864.844288:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586954240 00000100:00100000:0.0:1788271864.844517:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271864.844530:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+11:14400:x1875138586954240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271864.845047:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+11:14400:x1875138586954240:12345-0@lo:501:mount.lustre.0 Request processed in 519us (5070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271864.845057:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788271864.845162:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271864.845219:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271864.845268:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.854319:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271864.861012:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586954368 00000100:00100000:2.0:1788271864.861030:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586954368 00000100:00100000:2.0:1788271864.861129:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271864.861140:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:14400:x1875138586954368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271864.861403:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:14400:x1875138586954368:12345-0@lo:503:mount.lustre.0 Request processed in 264us (16134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271864.861410:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271864.862998:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271864.863764:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14444:1875138586954496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271864.863864:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.863912:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788271864.864101:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586954496 00000100:00100000:2.0:1788271864.864108:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586954496 00000100:00100000:2.0:1788271864.864155:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271864.864165:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:14444:x1875138586954496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271864.864453:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:14444:x1875138586954496:12345-0@lo:502:llog_process_th.0 Request processed in 288us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271864.864461:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271864.864467:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14444:1875138586954496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271864.864494:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271864.864506:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.864508:0:14444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788271864.864513:0:14444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6f73f3800 00000020:00000080:3.0:1788271864.864515:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271864.864522:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271864.864524:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.864525:0:14444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788271864.864527:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271864.864528:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.864529:0:14444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788271864.864531:0:14444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6f73f3800 00000020:00000080:3.0:1788271864.864532:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271864.864579:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271864.864582:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.864583:0:14444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788271864.864584:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271864.864585:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271864.864586:0:14444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788271864.864590:0:14444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab6f73f3800 00000020:00000080:3.0:1788271864.864591:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788271864.864616:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14444:1875138586954624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271864.864644:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.864666:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015f8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.866495:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586954624 00000100:00100000:1.0:1788271864.866507:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586954624 00000100:00100000:1.0:1788271864.866566:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788271864.866576:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+11:14444:x1875138586954624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271864.866905:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+11:14444:x1875138586954624:12345-0@lo:502:llog_process_th.0 Request processed in 327us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.866914:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271864.869607:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14444:1875138586954624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271864.869799:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271864.869814:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271864.869823:0:14444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788271864.869830:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788271864.870013:0:14400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788271864.870038:0:14400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271864.870062:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.870082:0:14400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271864.870140:0:14400:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788271864.870143:0:14400:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab6f73f3800 10000000:01000000:0.0:1788271864.870147:0:14400:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab6f73f3800 10000000:01000000:0.0:1788271864.870152:0:14400:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271864.870158:0:14400:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6f73f3800 from 1 10000000:01000000:0.0:1788271864.870161:0:14400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271864.870201:0:14400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375400/0xbeb05ca97b5f829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.870209:0:14400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375400/0xbeb05ca97b5f829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.870219:0:14400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375400/0xbeb05ca97b5f829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271864.870242:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788271864.870309:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.870349:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9365780 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.870737:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586954752 00000100:00100000:1.0:1788271864.870745:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586954752 00000100:00100000:1.0:1788271864.870823:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271864.870836:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+11:14400:x1875138586954752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271864.870850:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271864.870865:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6400/0xbeb05ca97b5f82a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f829b expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.870898:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6400/0xbeb05ca97b5f82a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f829b expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.870910:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6400/0xbeb05ca97b5f82a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f829b expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.870920:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6400, rc 0) 00000100:00100000:1.0:1788271864.870970:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+12:14400:x1875138586954752:12345-0@lo:101:mount.lustre.0 Request processed in 137us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.870979:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788271864.871483:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271864.871499:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375400/0xbeb05ca97b5f829b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82a2 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271864.871509:0:14400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375400/0xbeb05ca97b5f829b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f82a2 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271864.871573:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271864.871600:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.871808:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9365780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271864.877569:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586954880 00000100:00100000:0.0:1788271864.877582:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586954880 00000100:00100000:0.0:1788271864.877747:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271864.877760:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:14400:x1875138586954880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271864.878105:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:14400:x1875138586954880:12345-0@lo:501:mount.lustre.0 Request processed in 347us (6502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271864.878113:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271864.878174:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586954880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271864.878230:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586955008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271864.878274:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.878314:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9365780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271864.878497:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955008 00000100:00100000:2.0:1788271864.878502:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955008 00000100:00100000:2.0:1788271864.878541:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788271864.878550:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:14400:x1875138586955008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271864.878720:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:14400:x1875138586955008:12345-0@lo:503:mount.lustre.0 Request processed in 171us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271864.878727:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788271864.878772:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586955008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271864.879101:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14447:1875138586955136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271864.879139:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.879163:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d27409c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271864.879204:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955136 00000100:00100000:2.0:1788271864.879208:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955136 00000100:00100000:2.0:1788271864.879238:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788271864.879246:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+12:14447:x1875138586955136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271864.879402:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+12:14447:x1875138586955136:12345-0@lo:502:llog_process_th.0 Request processed in 157us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271864.879409:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788271864.879527:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14447:1875138586955136:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788271864.879579:0:14447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788271864.879594:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ab6e59d19b8) 00000020:00000080:0.0:1788271864.879612:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788271864.879680:0:14447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6f73f3800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788271864.879690:0:14447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6f73f3800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788271864.879692:0:14447:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6f73f3800 4 00010000:00080000:0.0:1788271864.879722:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6c31b8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:0.0:1788271864.881407:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788271864.881634:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788271864.881670:0:14447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788271864.881685:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbeb05ca97b5f82b0 00000100:00080000:0.0:1788271864.881695:0:14447:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271864.881701:0:14447:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab6c31b8800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:0.0:1788271864.881735:0:14447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6f7b3f800 x1875138586955264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271864.881776:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586955264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788271864.881860:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271864.881926:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955264 00000100:00100000:0.0:1788271864.881934:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955264 00000100:00100000:0.0:1788271864.881972:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271864.881981:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875138586955264:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788271864.882038:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875138586955264:12345-0@lo:38:llog_process_th.0 Request processed in 55us (178us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788271864.882045:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271864.882079:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271864.882086:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c31b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271864.882100:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788271864.882103:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586955264:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788271864.882122:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788271864.889745:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14447:1875138586955392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271864.895044:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271864.895127:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955392 00000100:00100000:0.0:1788271864.895129:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d2740b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.895142:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955392 00000100:00100000:1.0:1788271864.896016:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271864.896035:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:14447:x1875138586955392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271864.896389:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:14447:x1875138586955392:12345-0@lo:502:llog_process_th.0 Request processed in 358us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271864.902180:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b79826ef-d055-4784-972d-a5e369371347:14447:1875138586955392:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788271864.902229:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788271864.902311:0:14400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788271864.902331:0:14400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271864.902345:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375400/0xbeb05ca97b5f829b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82a2 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.902357:0:14400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6ff375400/0xbeb05ca97b5f829b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82a2 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788271864.902401:0:14400:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788271864.902406:0:14400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271864.902407:0:14400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271864.902408:0:14400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271864.902409:0:14400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271864.902411:0:14400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271864.902427:0:14400:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271864.902429:0:14400:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271864.902430:0:14400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271864.902432:0:14400:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271864.902435:0:14400:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788271864.902438:0:14400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271864.902439:0:14400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271864.902440:0:14400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271864.902441:0:14400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271864.902442:0:14400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271864.902443:0:14400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271864.902444:0:14400:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271864.902445:0:14400:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271864.902446:0:14400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271864.902447:0:14400:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271864.902468:0:14400:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788271864.902486:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586955520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788271864.902558:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271864.902602:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271864.903382:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955520 00000100:00100000:0.0:1788271864.903392:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955520 00000100:00100000:0.0:1788271864.903456:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271864.903465:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+13:14400:x1875138586955520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788271864.903501:0:14412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788271864.903515:0:14412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788271864.904238:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 20000000:01000000:0.0:1788271864.944500:0:14412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788271864.944524:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788271864.944577:0:14434:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788271864.944584:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788271864.944611:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.944640:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.944650:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.944694:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271864.944720:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 12 pid: 14410 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271864.944735:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875138586955648:0@lo:104: 00000100:00100000:2.0:1788271864.944818:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271864.944867:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271864.944943:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955648 00000100:00100000:1.0:1788271864.944951:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955648 00000100:00100000:1.0:1788271864.945015:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271864.945026:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+3:14434:x1875138586955648:12345-0@lo:104: 00010000:00010000:1.0:1788271864.945042:0:14401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.945114:0:14401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271864.945120:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+3:14434:x1875138586955648:12345-0@lo:104: Request processed in 97us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.945128:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788271864.945151:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271864.945157:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.945165:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7200 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:1.0:1788271864.945169:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.945178:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271864.945198:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271864.945204:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271864.945249:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.945257:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271864.945290:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.945297:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7200/0xbeb05ca97b5f827f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8286 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.945313:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271864.945315:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271864.945317:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271864.945334:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586955776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271864.945371:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875138586955648:0@lo:104: 00010000:00010000:1.0:1788271864.945392:0:14434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271864.946226:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271864.946386:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955776 00000100:00100000:1.0:1788271864.946394:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955776 00010000:00010000:1.0:1788271864.946606:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 13 pid: 14410 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271864.946705:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271864.946714:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+13:3278:x1875138586955776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271864.946727:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271864.946744:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 13 pid: 14410 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946756:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 13 pid: 14410 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946772:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f827f expref: 13 pid: 14410 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946796:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946805:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271864.946820:0:14403:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002237801s 00010000:00010000:1.0:1788271864.946825:0:14403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946832:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946839:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946846:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946852:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271864.946856:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946875:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946890:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.946901:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271864.946945:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+12:3278:x1875138586955776:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.946952:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271864.947003:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586955776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271864.947025:0:14434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.947034:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271864.947041:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024b600/0xbeb05ca97b5f82b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271864.956380:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+11:14400:x1875138586955520:12345-0@lo:253:mount.lustre.0 Request processed in 52906us (53811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271864.956396:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271864.957126:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:14400:1875138586955520:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788271864.957146:0:14400:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788271864.957151:0:14400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271864.957152:0:14400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271864.957154:0:14400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271864.957155:0:14400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271864.957156:0:14400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271864.957158:0:14400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271864.957159:0:14400:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271864.957160:0:14400:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271864.957173:0:14400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271864.957175:0:14400:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788271864.957190:0:14400:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788271864.963867:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271864.964364:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271864.965076:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788271864.965244:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788271864.966300:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788271864.966836:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788271864.975013:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788271864.975187:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788271864.975546:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788271864.975852:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788271864.976104:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788271864.976260:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788271865.008361:0:14400:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788271865.009303:0:14400:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788271865.009924:0:14458:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788271865.010016:0:14458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788271865.013773:0:14400:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788271865.013921:0:14400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788271865.014325:0:14400:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788271865.014333:0:14400:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788271865.014477:0:14400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271865.017348:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788271865.018133:0:14458:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788271865.018156:0:14458:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:2.0:1788271865.018335:0:14457:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788271865.018340:0:14457:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788271865.020032:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788271865.021001:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788271865.021052:0:14400:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788271865.022040:0:14400:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788271865.023947:0:14400:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788271865.032379:0:14400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788271865.078118:0:14400:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788271865.078161:0:14400:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa540818a3988 00100000:10000000:1.0:1788271865.078171:0:14400:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788271865.079268:0:14400:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788271865.079285:0:14400:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788271865.079300:0:14400:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788271865.079327:0:14400:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788271865.522662:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788271865.911377:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788271865.911385:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6f73f3800 from 6 10000000:01000000:3.0:1788271865.911389:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788271865.911467:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271865.911480:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271865.911491:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271865.911532:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586955904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271865.911600:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271865.911656:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f7e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271865.912227:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586955904 00000100:00100000:0.0:1788271865.912237:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586955904 00000100:00100000:0.0:1788271865.912287:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788271865.912296:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:14416:x1875138586955904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271865.912313:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271865.912336:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f82be expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271865.912358:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271865.912366:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271865.912384:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff375e00, rc 0) 00000100:00100000:0.0:1788271865.912458:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586955904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271865.912465:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788271865.912518:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586955904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271865.912535:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271865.912543:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271865.912602:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586956032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788271865.912635:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271865.912661:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271865.912674:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586956032 00000100:00100000:0.0:1788271865.912678:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586956032 00000100:00100000:0.0:1788271865.912698:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788271865.912704:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586956032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788271865.912718:0:14412:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788271865.912733:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788271865.912737:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788271865.912828:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586956032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271865.912835:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788271865.912864:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586956032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788271865.912909:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271865.912917:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271865.912924:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788271865.970707:0:14452:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271865.970718:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271865.971296:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788271865.971304:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788271866.548885:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788271866.999217:0:14452:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271866.999228:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271866.999800:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788271866.999866:0:14452:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271866.999899:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1788271867.570576:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271868.594656:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788271869.347858:0:14703:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788271869.635148:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271869.941833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271869.941839:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271869.941842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271869.941845:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271869.941848:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788271869.941852:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788271869.941856:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab6c31b8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271869.941867:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab6c31b8800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271869.941889:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ffad1500 x1875138586956288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788271869.941931:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271869.941948:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586956160:0@lo:400:kworker.0 00000100:00100000:1.0:1788271869.942015:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271869.943008:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586956288:0@lo:38:kworker.0 00000100:00100000:0.0:1788271869.943056:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271869.943100:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586956160 00000100:00100000:0.0:1788271869.943107:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586956160 00000100:00100000:0.0:1788271869.943143:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271869.943152:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+12:3278:x1875138586956160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271869.943356:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+12:3278:x1875138586956160:12345-0@lo:400:kworker.0 Request processed in 204us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271869.943363:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271869.943406:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586956160:0@lo:400:kworker.0 00000100:00100000:3.0:1788271869.943651:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586956288 00000100:00100000:3.0:1788271869.943655:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586956288 00000100:00100000:3.0:1788271869.943679:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271869.943685:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875138586956288:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788271869.943715:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:3.0:1788271869.943840:0:14420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbeb05ca97b5f82cc 00000004:00100000:3.0:1788271869.943854:0:14420:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788271869.943988:0:14420:0:(import.c:65:import_set_state_nolock()) ffff8ab6cabef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271869.944042:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875138586956288:12345-0@lo:38:kworker.0 Request processed in 357us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271869.944049:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788271869.944094:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab6ffad1500 x1875138586956288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271869.944108:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788271869.944115:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788271869.944119:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788271869.944121:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c31b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788271869.944126:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875138586956288:0@lo:38:kworker.0 00010000:00010000:2.0:1788271870.645290:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271871.666935:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788271872.332035:0:14854:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc2356f80 20000000:00000080:3.0:1788271872.332054:0:14854:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab6eeed2800 uarg=0000000000000000 20000000:01000000:3.0:1788271872.332087:0:14854:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788271872.332096:0:14854:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788271872.332100:0:14854:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788271872.332965:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788271872.333120:0:14854:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788271872.339800:0:14854:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788271872.339827:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271872.339843:0:14854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271872.339860:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271872.339901:0:14854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271872.339914:0:14854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 11 pid: 14413 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271872.339929:0:14854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14854:1875138586956416:0@lo:104: 00000100:00100000:3.0:1788271872.339993:0:14854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271872.340048:0:14854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6caaa4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271872.340106:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586956416 00000100:00100000:2.0:1788271872.340114:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586956416 00000100:00100000:2.0:1788271872.340168:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271872.340178:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b79826ef-d055-4784-972d-a5e369371347+3:14854:x1875138586956416:12345-0@lo:104: 00010000:00010000:2.0:1788271872.340191:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.340275:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788271872.340282:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b79826ef-d055-4784-972d-a5e369371347+3:14854:x1875138586956416:12345-0@lo:104: Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271872.340289:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788271872.340518:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271872.340524:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271872.340537:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271872.340540:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271872.340546:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271872.340550:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271872.340553:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788271872.340643:0:14854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14854:1875138586956416:0@lo:104: 00010000:00010000:3.0:1788271872.340674:0:14854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271872.340725:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271872.340731:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271872.340759:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271872.340766:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab70024be00/0xbeb05ca97b5f828d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8294 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271872.340782:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271872.340784:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271872.340785:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271872.340793:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271872.340804:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586956544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271872.340836:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271872.340875:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586956544 00000100:00100000:2.0:1788271872.340888:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586956544 00010000:00010000:2.0:1788271872.340909:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 12 pid: 14413 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271872.341040:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271872.341050:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+12:3281:x1875138586956544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271872.341070:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271872.341076:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 12 pid: 14413 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341087:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 12 pid: 14413 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341101:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee6600/0xbeb05ca97b5f8294 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f828d expref: 12 pid: 14413 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341112:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341119:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341132:0:14403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341140:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341146:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341153:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341158:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271872.341162:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341180:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341191:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271872.341200:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271872.341244:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+11:3281:x1875138586956544:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271872.341252:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788271872.341305:0:14854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271872.341313:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271872.341319:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6dee18400/0xbeb05ca97b5f82d3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271872.341598:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586956544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271872.692377:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271873.715609:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271874.034710:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271864/real 1788271864] req@ffff8ab6f79b4700 x1875138586953600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271874.034758:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6f79b4700 x1875138586953600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271874.034793:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271864/real 1788271864] req@ffff8ab6f79b4e00 x1875138586953344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271874.034807:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6f79b4e00 x1875138586953344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788271874.034830:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271874.034860:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788271874.034865:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586953600:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788271874.034872:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0e9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271874.034949:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788271874.034954:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586953344:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788271874.035259:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586956672:0@lo:400:kworker.0 00000100:00100000:0.0:1788271874.035353:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788271874.035492:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271874.035497:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788271874.035500:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0e9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271874.035506:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:2.0:1788271874.035513:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788271874.035520:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab6ee0e9000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271874.035548:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ffad0000 x1875138586956800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271874.035563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271874.035567:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788271874.035569:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271874.035572:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:2.0:1788271874.035574:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788271874.035578:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab6c3184000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271874.035590:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ffad3100 x1875138586956928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788271874.035731:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586956672 00000100:00100000:1.0:1788271874.035742:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586956672 00000100:00100000:1.0:1788271874.035810:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788271874.035822:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:3281:x1875138586956672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271874.036038:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271874.036050:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586957056:0@lo:400:kworker.0 00000100:00100000:3.0:1788271874.036098:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271874.036147:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586956800:0@lo:8:kworker.0 00000400:00000100:3.0:1788271874.036175:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138586956800 offset 0 length 520: 4 00000100:00100000:3.0:1788271874.036195:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586956928:0@lo:8:kworker.0 00000400:00000100:3.0:1788271874.036218:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138586956928 offset 0 length 520: 4 00000100:00100000:2.0:1788271874.039040:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957056 00000100:00100000:2.0:1788271874.039057:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957056 00000100:00100000:2.0:1788271874.039125:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271874.039150:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586957056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271874.039270:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586957056:12345-0@lo:400:kworker.0 Request processed in 134us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271874.039278:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788271874.039346:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab6ffad3b80 x1875138586957056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271874.039366:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586957056:0@lo:400:kworker.0 00000100:00100000:1.0:1788271874.048104:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+11:3281:x1875138586956672:12345-0@lo:400:kworker.0 Request processed in 12267us (12734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271874.048127:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788271874.049609:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586956672:0@lo:400:kworker.0 10000000:01000000:1.0:1788271874.098618:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271874.098639:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6f73f3800 from 10 10000000:01000000:1.0:1788271874.098646:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271874.098725:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271874.098741:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271874.098785:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271874.098822:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586957184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271874.098925:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271874.099021:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ede38240 going to sleep for 11 seconds 00000100:00100000:0.0:1788271874.099333:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957184 00000100:00100000:0.0:1788271874.099344:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957184 00000100:00100000:0.0:1788271874.099454:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271874.099468:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+11:14416:x1875138586957184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271874.099488:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271874.099507:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f82da expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271874.099538:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271874.099550:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271874.099562:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ff374a00, rc 0) 00000100:00100000:0.0:1788271874.099614:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586957184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271874.099621:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788271874.099812:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586957184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271874.099833:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271874.099844:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271874.099918:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586957312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271874.099950:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271874.099992:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ede38240 going to sleep for 11 seconds 00000100:00100000:0.0:1788271874.100102:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957312 00000100:00100000:0.0:1788271874.100107:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957312 00000100:00100000:0.0:1788271874.100242:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271874.100251:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586957312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271874.102116:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586957312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1857us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271874.102203:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788271874.102339:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586957312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271874.102395:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586957440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271874.102466:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271874.111220:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ede38240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271874.111513:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957440 00000100:00100000:2.0:1788271874.111525:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957440 00000100:00100000:2.0:1788271874.112299:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788271874.112316:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586957440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271874.113021:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:14416:x1875138586957440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 708us (10552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271874.113032:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788271874.113339:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586957440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788271874.119349:0:14924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788271874.120604:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788271874.120649:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271874.120665:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271874.120688:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271874.738554:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271875.764676:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271876.211257:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788271876.786598:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788271877.379180:0:15104:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788271877.379184:0:15104:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788271877.379341:0:15104:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab6c3077000 00000020:01000004:3.0:1788271877.379357:0:15104:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788271877.379369:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788271877.379386:0:15104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ab6fee4b370) 00000020:00000080:3.0:1788271877.379538:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788271877.397288:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788271877.397683:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788271877.398656:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788271877.398999:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788271877.399221:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788271877.399753:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 539: rc = 0 00100000:10000000:2.0:1788271877.399970:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 539: rc = 0 00100000:10000000:2.0:1788271877.400064:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:2.0:1788271877.400606:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:2.0:1788271877.401023:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 772: rc = 0 00100000:10000000:2.0:1788271877.401267:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 772: rc = 0 00100000:10000000:2.0:1788271877.401632:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:2.0:1788271877.401914:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:3.0:1788271877.406685:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 772: rc = 0 00000020:00000080:3.0:1788271877.407347:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788271877.407536:0:15104:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788271877.407548:0:15104:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbeb05ca97b5f82ef 00000020:01000004:3.0:1788271877.407557:0:15104:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788271877.407589:0:15104:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788271877.407593:0:15104:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788271877.407599:0:15104:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788271877.407604:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788271877.407624:0:15104:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ab6f2dfcd28) 00000020:00000080:3.0:1788271877.407637:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788271877.408734:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271877.408878:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788271877.408884:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788271877.409583:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788271877.409591:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788271877.410077:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788271877.410084:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788271877.414573:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271877.414718:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788271877.414722:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788271877.415593:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788271877.415601:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788271877.455219:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271877.458788:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788271877.458803:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788271877.460290:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788271877.460303:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788271877.464007:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271877.464023:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788271877.468221:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271877.468809:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788271877.468817:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788271877.469315:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788271877.469323:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788271877.501687:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271877.501926:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788271877.501933:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788271877.503129:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788271877.503140:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788271877.503626:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788271877.503649:0:15104:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788271877.503656:0:15104:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788271877.513036:0:15104:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788271877.513075:0:15104:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788271877.513080:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788271877.513082:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788271877.513084:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271877.513085:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271877.513086:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271877.513087:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271877.513089:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271877.513091:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271877.513092:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271877.513102:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788271877.513105:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788271877.513106:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788271877.513107:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271877.513108:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271877.513109:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271877.513110:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271877.513111:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271877.513112:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271877.513113:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271877.513141:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788271877.513162:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788271877.513259:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271877.513405:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab5c1e3cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271877.513663:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957568 00000100:00100000:2.0:1788271877.513673:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957568 00000100:00100000:2.0:1788271877.513737:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788271877.513747:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:15104:x1875138586957568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788271877.513779:0:14412:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788271877.513783:0:14412:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788271877.513787:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788271877.530616:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:15104:x1875138586957568:12345-0@lo:253:mount.lustre.0 Request processed in 16863us (17350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.530628:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271877.530724:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788271877.530737:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788271877.530740:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788271877.530741:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788271877.530742:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271877.530743:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271877.530744:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271877.530745:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271877.530746:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271877.530748:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271877.530748:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788271877.530770:0:15104:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab6c3077000 from lustre-OST0000 10000000:01000000:0.0:1788271877.530794:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788271877.530796:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788271877.530801:0:15104:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab6e5924d28 local copy 00010000:00010000:0.0:1788271877.530811:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271877.531437:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271877.531480:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271877.531528:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271877.531544:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957696 00000100:00100000:2.0:1788271877.531552:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957696 00000100:00100000:2.0:1788271877.531608:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788271877.531618:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:15104:x1875138586957696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271877.531765:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+12:15104:x1875138586957696:12345-0@lo:501:mount.lustre.0 Request processed in 148us (284us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271877.531773:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788271877.531789:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957696:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788271877.531806:0:15104:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788271877.532089:0:15104:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788271877.532096:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532104:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271877.532122:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab6c3077000 10000000:01000000:0.0:1788271877.532126:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788271877.532129:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ab6e5924d28 10000000:01000000:0.0:1788271877.532131:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788271877.532133:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ab6e5924d28 from 1 10000000:01000000:0.0:1788271877.532136:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788271877.532156:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374400/0xbeb05ca97b5f82fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532161:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374400/0xbeb05ca97b5f82fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532167:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374400/0xbeb05ca97b5f82fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271877.532176:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788271877.532197:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271877.532212:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271877.532238:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957824 00000100:00100000:2.0:1788271877.532248:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957824 00000100:00100000:2.0:1788271877.532274:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788271877.532281:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+12:15104:x1875138586957824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271877.532291:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271877.532304:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024a000/0xbeb05ca97b5f8304 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f82fd expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.532324:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024a000/0xbeb05ca97b5f8304 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82fd expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.532335:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024a000/0xbeb05ca97b5f8304 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82fd expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.532343:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a000, rc 0) 00000100:00100000:2.0:1788271877.532370:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+13:15104:x1875138586957824:12345-0@lo:101:mount.lustre.0 Request processed in 90us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.532376:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788271877.532392:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271877.532432:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374400/0xbeb05ca97b5f82fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8304 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532442:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374400/0xbeb05ca97b5f82fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8304 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271877.532461:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788271877.532478:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374400/0xbeb05ca97b5f82fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8304 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532485:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374400/0xbeb05ca97b5f82fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8304 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271877.532492:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788271877.532496:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271877.532499:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788271877.532502:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788271877.532514:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374c00/0xbeb05ca97b5f830b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532521:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374c00/0xbeb05ca97b5f830b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532536:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374c00/0xbeb05ca97b5f830b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271877.532549:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788271877.532586:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271877.532613:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9f9f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271877.532629:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586957952 00000100:00100000:2.0:1788271877.532633:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586957952 00000100:00100000:2.0:1788271877.532656:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271877.532662:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+13:15104:x1875138586957952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271877.532669:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271877.532677:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024a400/0xbeb05ca97b5f8312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f830b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.532690:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024a400/0xbeb05ca97b5f8312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f830b expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.532698:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024a400/0xbeb05ca97b5f8312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f830b expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.532711:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a400, rc 0) 00000100:00100000:2.0:1788271877.532739:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586957952:12345-0@lo:101:mount.lustre.0 Request processed in 77us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.532745:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788271877.532750:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586957952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271877.532759:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374c00/0xbeb05ca97b5f830b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8312 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.532767:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374c00/0xbeb05ca97b5f830b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8312 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271877.533596:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788271877.535252:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271877.535450:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788271877.535480:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788271877.535496:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788271877.535520:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788271877.535545:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788271877.535591:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788271877.535641:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788271877.535647:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788271877.535710:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271877.535759:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271877.535788:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c11ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271877.535848:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958080 00000100:00100000:0.0:1788271877.535855:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958080 00000100:00100000:0.0:1788271877.535906:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788271877.535924:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271877.536232:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958080:12345-0@lo:501:mount.lustre.0 Request processed in 308us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271877.536240:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271877.536450:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271877.536474:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271877.536503:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271877.536526:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c11ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271877.536560:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958208 00000100:00100000:1.0:1788271877.536576:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958208 00000100:00100000:1.0:1788271877.536607:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271877.536612:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271877.536859:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958208:12345-0@lo:503:mount.lustre.0 Request processed in 245us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271877.536867:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271877.537138:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788271877.537688:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271877.537752:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271877.537801:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271877.537845:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d22d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271877.538080:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958336 00000100:00100000:0.0:1788271877.538084:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958336 00000100:00100000:0.0:1788271877.538113:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788271877.538122:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271877.538283:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958336:12345-0@lo:502:mount.lustre.0 Request processed in 161us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271877.538290:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788271877.538310:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271877.538745:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788271877.538789:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788271877.538825:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788271877.538873:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788271877.539438:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788271877.539480:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788271877.540139:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788271877.540198:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788271877.540234:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788271877.540292:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788271877.540332:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788271877.540380:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788271877.540462:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271877.540613:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271877.540722:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d22d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271877.540779:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958464 00000100:00100000:3.0:1788271877.540786:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958464 00000100:00100000:3.0:1788271877.540842:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788271877.540852:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271877.541271:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958464:12345-0@lo:502:mount.lustre.0 Request processed in 419us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271877.541279:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271877.541365:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271877.541463:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788271877.541474:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788271877.542659:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788271877.542670:0:15118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788271877.542677:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271877.542679:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788271877.542685:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271877.542701:0:15118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ab6c9f08000) 00000020:00000080:2.0:1788271877.542723:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788271877.542729:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271877.542786:0:15118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6c3077000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788271877.542793:0:15118:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271877.542804:0:15118:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbeb05ca97b5f8320 00010000:00010000:2.0:1788271877.551343:0:15118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788271877.552679:0:15118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788271877.554380:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788271877.556635:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788271877.556649:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271877.556655:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271877.556658:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788271877.556661:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788271877.556664:0:15118:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788271877.556666:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788271877.556667:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788271877.556669:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788271877.556672:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271877.556673:0:15118:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788271877.556676:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271877.556679:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271877.556680:0:15118:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271877.556683:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271877.556685:0:15118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788271877.556687:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271877.556690:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271877.556691:0:15118:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788271877.556694:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271877.556696:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271877.556698:0:15118:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788271877.556701:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788271877.556763:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271877.556767:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271877.556768:0:15118:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788271877.556771:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788271877.558159:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788271877.558192:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788271877.558221:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374c00/0xbeb05ca97b5f830b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8312 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.558234:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6ff374c00/0xbeb05ca97b5f830b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8312 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271877.558252:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c3077000 from 1 10000000:01000000:3.0:1788271877.558255:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271877.558291:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.558299:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.558310:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271877.558336:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271877.558403:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.558476:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d1bb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271877.558585:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958592 00000100:00100000:2.0:1788271877.558593:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958592 00000100:00100000:2.0:1788271877.558633:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271877.558648:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+14:15104:x1875138586958592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271877.558661:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271877.558674:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f8327 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.558696:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 15 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.558707:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 15 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271877.558715:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271877.558755:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586958592:12345-0@lo:101:mount.lustre.0 Request processed in 108us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.558762:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271877.558908:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271877.558935:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.558943:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271877.559498:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788271877.559878:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271877.560129:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788271877.560174:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788271877.560236:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788271877.560244:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788271877.560304:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271877.560359:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.560396:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d1bb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271877.561152:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958720 00000100:00100000:2.0:1788271877.561161:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958720 00000100:00100000:2.0:1788271877.561208:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788271877.561218:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586958720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271877.561457:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586958720:12345-0@lo:501:mount.lustre.0 Request processed in 240us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.561465:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788271877.564692:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271877.564761:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271877.564838:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.564872:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d1bb1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271877.565041:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958848 00000100:00100000:1.0:1788271877.565046:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958848 00000100:00100000:1.0:1788271877.565084:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788271877.565093:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586958848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271877.565264:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586958848:12345-0@lo:503:mount.lustre.0 Request processed in 172us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271877.565272:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788271877.565292:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788271877.566153:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271877.566218:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271877.566261:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.566298:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4ee1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271877.566354:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586958976 00000100:00100000:2.0:1788271877.566359:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586958976 00000100:00100000:2.0:1788271877.566397:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788271877.566406:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586958976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271877.566765:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586958976:12345-0@lo:502:mount.lustre.0 Request processed in 360us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.566782:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788271877.566850:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586958976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271877.567206:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788271877.567254:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788271877.567315:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788271877.567353:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788271877.567382:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788271877.567628:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788271877.567669:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788271877.567702:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788271877.567735:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271877.567784:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.567869:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4ee1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788271877.567984:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586959104 00000100:00100000:1.0:1788271877.567990:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586959104 00000100:00100000:1.0:1788271877.568072:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788271877.568088:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586959104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271877.568294:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586959104:12345-0@lo:502:mount.lustre.0 Request processed in 206us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271877.568302:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271877.568384:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788271877.568516:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788271877.568527:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788271877.569458:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271877.569471:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271877.569474:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788271877.569491:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c3077000 00000020:00000080:0.0:1788271877.569494:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788271877.569501:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271877.569503:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271877.569505:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788271877.569507:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271877.569510:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271877.569511:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788271877.569514:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c3077000 00000020:00000080:0.0:1788271877.569516:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788271877.569597:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271877.571247:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271877.571254:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788271877.571262:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271877.571267:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271877.571268:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271877.571273:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab6c3077000 00000020:00000080:0.0:1788271877.571275:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788271877.573690:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271877.573702:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271877.573704:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788271877.573709:0:15122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788271877.574086:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788271877.574120:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271877.574143:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.574164:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271877.574214:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788271877.574218:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab6c3077000 10000000:01000000:3.0:1788271877.574221:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab6c3077000 10000000:01000000:3.0:1788271877.574225:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788271877.574230:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c3077000 from 1 10000000:01000000:3.0:1788271877.574233:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271877.574267:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18e00/0xbeb05ca97b5f8335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.574275:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18e00/0xbeb05ca97b5f8335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.574286:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18e00/0xbeb05ca97b5f8335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271877.574308:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271877.574391:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.574452:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4ee1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271877.575040:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586959232 00000100:00100000:3.0:1788271877.575049:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586959232 00000100:00100000:3.0:1788271877.575093:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271877.575102:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586959232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271877.575118:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271877.575132:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f833c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f8335 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.575165:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f833c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8335 expref: 16 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.575175:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19400/0xbeb05ca97b5f833c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8335 expref: 16 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.575184:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19400, rc 0) 00000100:00100000:3.0:1788271877.575226:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959232:12345-0@lo:101:mount.lustre.0 Request processed in 125us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271877.575233:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271877.575283:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271877.575297:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18e00/0xbeb05ca97b5f8335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f833c expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.575306:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18e00/0xbeb05ca97b5f8335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f833c expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271877.576751:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788271877.577813:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271877.578284:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788271877.578330:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788271877.578363:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788271877.578491:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788271877.578620:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788271877.578689:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788271877.578730:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788271877.578766:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788271877.578814:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788271877.578861:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788271877.578897:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788271877.580128:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788271877.580177:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788271877.580231:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788271877.580292:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788271877.580326:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788271877.580358:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788271877.580404:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788271877.581662:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788271877.581710:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788271877.581776:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788271877.581813:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788271877.581847:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788271877.581895:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788271877.583040:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788271877.583083:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788271877.583138:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788271877.583174:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788271877.583263:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788271877.583271:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788271877.583379:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271877.585203:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.585255:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4ee1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271877.585338:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586959360 00000100:00100000:1.0:1788271877.585347:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586959360 00000100:00100000:1.0:1788271877.585396:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788271877.585405:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271877.585746:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959360:12345-0@lo:501:mount.lustre.0 Request processed in 341us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271877.585754:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788271877.587255:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271877.587310:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271877.587438:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.587463:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c4ee1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271877.587543:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586959488 00000100:00100000:0.0:1788271877.587550:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586959488 00000100:00100000:0.0:1788271877.587615:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788271877.587624:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271877.587788:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959488:12345-0@lo:503:mount.lustre.0 Request processed in 163us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271877.587795:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271877.587941:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788271877.588449:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271877.588505:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271877.588679:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.588702:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ca344c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271877.588770:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586959616 00000100:00100000:0.0:1788271877.588775:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586959616 00000100:00100000:0.0:1788271877.588811:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271877.588826:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271877.589066:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959616:12345-0@lo:502:mount.lustre.0 Request processed in 241us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271877.589073:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271877.589154:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271877.589409:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788271877.589486:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788271877.589525:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788271877.589864:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788271877.589901:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788271877.590062:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788271877.590101:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788271877.590135:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788271877.590183:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788271877.590218:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788271877.590253:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788271877.590300:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788271877.590339:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788271877.590392:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788271877.590478:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788271877.590514:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788271877.593130:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788271877.593233:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788271877.593272:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788271877.593306:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788271877.593392:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788271877.593463:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788271877.593498:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788271877.595513:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788271877.596059:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788271877.596108:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788271877.596161:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788271877.596195:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788271877.596225:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788271877.596294:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788271877.596332:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788271877.596367:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788271877.596399:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788271877.598135:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788271877.598190:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788271877.598245:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788271877.598286:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788271877.598324:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788271877.598376:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788271877.598470:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788271877.599998:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271877.600098:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271877.600202:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ca344c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271877.607581:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586959744 00000100:00100000:1.0:1788271877.607599:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586959744 00000100:00100000:1.0:1788271877.608902:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788271877.608929:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271877.609250:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586959744:12345-0@lo:502:mount.lustre.0 Request processed in 325us (9151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271877.609259:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788271877.610691:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586959744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271877.610838:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788271877.610854:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788271877.622241:0:15127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788271877.622264:0:15127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ab6c9f0b370) 00000020:00000080:2.0:1788271877.622290:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788271877.622384:0:15127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6c3077000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788271877.622387:0:15127:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6c3077000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788271877.622390:0:15127:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c3077000 3 00010000:00080000:2.0:1788271877.622434:0:15127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6fe9be800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.101@tcp at head 00010000:00010000:2.0:1788271877.623995:0:15127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788271877.624166:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788271877.624195:0:15127:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788271877.624207:0:15127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbeb05ca97b5f834a 00000100:00080000:2.0:1788271877.624217:0:15127:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271877.624223:0:15127:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab6fe9be800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271877.624259:0:15127:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ffad3b80 x1875138586959872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271877.624294:0:15127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788271877.624401:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875138586959872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788271877.624480:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788271877.626887:0:14475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271877.626896:0:14475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271877.626899:0:14475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271877.626902:0:14475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788271877.627038:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271877.627056:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586960000:0@lo:400:kworker.0 00000100:00100000:0.0:1788271877.627135:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271877.627472:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586959872 00000100:00100000:2.0:1788271877.627480:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586959872 00000100:00100000:2.0:1788271877.627510:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960000 00000100:00100000:2.0:1788271877.627513:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960000 00000100:00100000:2.0:1788271877.627550:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271877.627571:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586960000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271877.627624:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586960000:12345-0@lo:400:kworker.0 Request processed in 65us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.627631:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271877.627651:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271877.627664:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875138586959872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788271877.627687:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788271877.627721:0:14418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbeb05ca97b5f8351 00000004:00100000:2.0:1788271877.627738:0:14418:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788271877.627774:0:14418:0:(import.c:65:import_set_state_nolock()) ffff8ab6c822c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271877.627809:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875138586959872:12345-0@lo:38:llog_process_th.0 Request processed in 144us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271877.627815:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788271877.628965:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab6ffad3b80 x1875138586959872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271877.628990:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00010000:00080000:0.0:1788271877.628994:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab6f7b3ea00 x1875138586960000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788271877.628999:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00100000:0.0:1788271877.629004:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586960000:0@lo:400:kworker.0 00000100:00080000:3.0:1788271877.629007:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788271877.629011:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788271877.629025:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6fe9be800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788271877.629031:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875138586959872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788271877.632165:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788271877.632320:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788271877.632353:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788271877.632377:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18e00/0xbeb05ca97b5f8335 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f833c expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271877.632390:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18e00/0xbeb05ca97b5f8335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f833c expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788271877.632468:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788271877.632474:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271877.632475:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271877.632476:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271877.632477:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271877.632479:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271877.632480:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271877.632481:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271877.632483:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271877.632486:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788271877.632488:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788271877.632490:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271877.632490:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271877.632491:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271877.632492:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271877.632493:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271877.632494:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271877.632495:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271877.632495:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271877.632523:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788271877.632649:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586960128:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788271877.632725:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271877.632769:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61cc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271877.632821:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960128 00000100:00100000:3.0:1788271877.632829:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960128 00000100:00100000:3.0:1788271877.632877:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271877.632887:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:15104:x1875138586960128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788271877.632925:0:14410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788271877.632938:0:14410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788271877.668235:0:14410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788271877.668256:0:14410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788271877.668314:0:14434:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788271877.668319:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788271877.668344:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.668364:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.668373:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.668447:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.668477:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 16 pid: 14413 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271877.668494:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875138586960256:0@lo:104: 00000100:00100000:0.0:1788271877.668587:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271877.668631:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f77ad300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271877.669232:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960256 00000100:00100000:3.0:1788271877.669241:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960256 00000100:00100000:3.0:1788271877.669303:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271877.669314:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+3:14434:x1875138586960256:12345-0@lo:104: 00010000:00010000:3.0:1788271877.669332:0:14401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271877.669395:0:14401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271877.669401:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+3:14434:x1875138586960256:12345-0@lo:104: Request processed in 90us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271877.669409:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788271877.670520:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271877.670615:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.670628:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271877.670634:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.670644:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271877.670652:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271877.670658:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271877.670706:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.670714:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271877.670748:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.670756:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18000/0xbeb05ca97b5f82be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f82c5 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.670791:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271877.670792:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271877.670794:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271877.670811:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271877.670828:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586960384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271877.670885:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271877.671018:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960384 00000100:00100000:0.0:1788271877.671025:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960384 00010000:00010000:0.0:1788271877.671052:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 17 pid: 14413 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271877.671079:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271877.671087:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b79826ef-d055-4784-972d-a5e369371347+17:3281:x1875138586960384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271877.671116:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271877.671122:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 17 pid: 14413 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671134:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 17 pid: 14413 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671153:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671162:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788271877.671179:0:14405:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002860627s 00010000:00010000:0.0:1788271877.671184:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671196:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671203:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671209:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671214:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271877.671219:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671226:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671234:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671244:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271877.671277:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b79826ef-d055-4784-972d-a5e369371347+17:3281:x1875138586960384:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271877.671286:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271877.671333:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586960384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271877.671370:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6ff375e00/0xbeb05ca97b5f82c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f82be expref: 16 pid: 14413 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271877.671380:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875138586960256:0@lo:104: 00010000:00010000:0.0:1788271877.671392:0:14434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671407:0:14434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671441:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271877.671447:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6ff374600/0xbeb05ca97b5f8358 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271877.678993:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+15:15104:x1875138586960128:12345-0@lo:253:mount.lustre.0 Request processed in 46098us (46258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271877.679009:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788271877.679124:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15104:1875138586960128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788271877.679140:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788271877.679144:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271877.679145:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271877.679147:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271877.679148:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271877.679149:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271877.679150:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271877.679152:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271877.679154:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271877.679155:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788271877.679172:0:15104:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788271877.683514:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788271877.683900:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788271877.684082:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788271877.684239:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788271877.684335:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788271877.684679:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788271877.685923:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788271877.735248:0:15104:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788271877.735257:0:15104:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788271877.735297:0:15104:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788271877.735358:0:15104:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788271877.735371:0:15104:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788271877.735402:0:15104:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788271877.811665:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271878.836629:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788271879.154490:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788271879.154501:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6f73f3800 from 7 10000000:01000000:2.0:1788271879.154506:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271879.154577:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271879.154597:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271879.154611:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271879.154637:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586960512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271879.154714:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271879.154779:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271879.155114:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960512 00000100:00100000:1.0:1788271879.155122:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960512 00000100:00100000:1.0:1788271879.155182:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271879.155193:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+15:14416:x1875138586960512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271879.155409:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271879.155449:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f835f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271879.155472:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271879.155483:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271879.155501:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6800, rc 0) 00000100:00100000:1.0:1788271879.155559:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:14416:x1875138586960512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 367us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271879.155566:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788271879.155740:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586960512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271879.155757:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271879.155766:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271879.155824:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586960640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788271879.155858:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271879.155894:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c61cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271879.156003:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960640 00000100:00100000:0.0:1788271879.156009:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960640 00000100:00100000:0.0:1788271879.156046:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271879.156054:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:14416:x1875138586960640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788271879.156069:0:14410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788271879.156096:0:14410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788271879.156100:0:14410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788271879.156194:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:14416:x1875138586960640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271879.156208:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788271879.156506:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586960640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788271879.156578:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788271879.156585:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271879.156594:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271879.858744:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271880.888723:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271881.907539:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271882.743390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271882.743397:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271882.743400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271882.743403:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788271882.743464:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271882.743497:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b79826ef-d055-4784-972d-a5e369371347:3280:1875138586960768:0@lo:400:kworker.0 00000100:00100000:2.0:1788271882.743683:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271882.744153:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586960896:0@lo:400:kworker.0 00000100:00100000:2.0:1788271882.744183:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271882.744213:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271882.744218:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586961024:0@lo:400:kworker.0 00000100:00100000:2.0:1788271882.744244:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271882.744279:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960896 00000100:00100000:2.0:1788271882.744287:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960896 00000100:00100000:2.0:1788271882.744326:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961024 00000100:00100000:2.0:1788271882.744328:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961024 00000100:00100000:2.0:1788271882.744354:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271882.744362:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586960896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271882.744432:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586960896:12345-0@lo:400:kworker.0 Request processed in 51us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271882.744440:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271882.744460:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271882.744466:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586961024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271882.744505:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586961024:12345-0@lo:400:kworker.0 Request processed in 39us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271882.744585:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788271882.744619:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788271882.744647:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ffad1f80 x1875138586961024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271882.744661:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586961024:0@lo:400:kworker.0 00010000:00080000:2.0:1788271882.744685:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ffad0e00 x1875138586960896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271882.744692:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586960896:0@lo:400:kworker.0 00000100:00100000:1.0:1788271882.748256:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586960768 00000100:00100000:1.0:1788271882.748271:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586960768 00000100:00100000:1.0:1788271882.748341:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271882.748351:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:3280:x1875138586960768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271882.748469:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:3280:x1875138586960768:12345-0@lo:400:kworker.0 Request processed in 119us (4784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271882.748487:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788271882.748670:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b79826ef-d055-4784-972d-a5e369371347:3280:1875138586960768:0@lo:400:kworker.0 00010000:00010000:1.0:1788271882.930646:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271883.966827:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788271883.968176:0:15474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788271884.978723:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271886.002737:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788271886.451505:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271887.035679:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788271887.863179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271887.863188:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788271887.863191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271887.863195:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788271887.863290:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586961408:0@lo:400:kworker.0 00000100:00100000:1.0:1788271887.863534:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b79826ef-d055-4784-972d-a5e369371347:3280:1875138586961152:0@lo:400:kworker.0 00000100:00100000:0.0:1788271887.865814:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586961280:0@lo:400:kworker.0 00000100:00100000:1.0:1788271887.866725:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271887.866951:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271887.867192:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961408 00000100:00100000:1.0:1788271887.867202:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961408 00000100:00100000:2.0:1788271887.867641:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961152 00000100:00100000:2.0:1788271887.867647:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961152 00000100:00100000:2.0:1788271887.867692:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788271887.867704:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:3280:x1875138586961152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271887.867796:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:3280:x1875138586961152:12345-0@lo:400:kworker.0 Request processed in 94us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271887.867804:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788271887.868161:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b79826ef-d055-4784-972d-a5e369371347:3280:1875138586961152:0@lo:400:kworker.0 00000100:00100000:1.0:1788271887.868533:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271887.868548:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586961408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271887.868611:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586961408:12345-0@lo:400:kworker.0 Request processed in 69us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271887.868618:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788271887.868875:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788271887.869893:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6f79b4000 x1875138586961408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271887.869913:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586961408:0@lo:400:kworker.0 00000100:00100000:0.0:1788271887.870113:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271887.870537:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961280 00000100:00100000:3.0:1788271887.870546:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961280 00000100:00100000:3.0:1788271887.870608:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271887.870619:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586961280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271887.870681:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586961280:12345-0@lo:400:kworker.0 Request processed in 64us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271887.870689:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788271887.871563:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6f79b5f80 x1875138586961280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271887.871580:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586961280:0@lo:400:kworker.0 00010000:00010000:2.0:1788271888.059656:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.079860:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271889.907093:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271874/real 1788271874] req@ffff8ab6ffad0000 x1875138586956800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271889 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271889.907133:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6ffad0000 x1875138586956800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271889 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271889.907157:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271874/real 1788271874] req@ffff8ab6ffad3100 x1875138586956928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271889 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271889.907170:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6ffad3100 x1875138586956928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271889 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271889.907210:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0e9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271889.907274:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271889.907280:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586956800:0@lo:8:kworker.0 00000100:00080000:2.0:1788271889.907286:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271889.909604:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271889.909612:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788271889.909617:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0e9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271889.909626:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788271889.909633:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788271889.909642:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab6ee0e9000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:0.0:1788271889.909670:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6f7b3c700 x1875138586961664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271889.909683:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271889.909687:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788271889.909688:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271889.909692:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788271889.909694:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788271889.909698:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab6c3184000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:0.0:1788271889.909711:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6f7b3dc00 x1875138586961792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271889.909790:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b79826ef-d055-4784-972d-a5e369371347:3279:1875138586961536:0@lo:400:kworker.0 00000100:00100000:0.0:1788271889.909889:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271889.909988:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586961920:0@lo:400:kworker.0 00000100:00100000:0.0:1788271889.910042:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271889.910069:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271889.910075:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586962048:0@lo:400:kworker.0 00000100:00100000:0.0:1788271889.910106:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271889.910377:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961536 00000100:00100000:0.0:1788271889.910386:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961536 00000100:00100000:0.0:1788271889.910474:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271889.910486:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:3279:x1875138586961536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271889.910550:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+16:3279:x1875138586961536:12345-0@lo:400:kworker.0 Request processed in 66us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271889.910558:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271889.910601:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961920 00000100:00100000:0.0:1788271889.910605:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961920 00000100:00100000:0.0:1788271889.910630:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962048 00000100:00100000:0.0:1788271889.910633:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962048 00000100:00100000:0.0:1788271889.910661:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271889.910667:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586961920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271889.910705:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586961920:12345-0@lo:400:kworker.0 Request processed in 38us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271889.910711:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271889.910724:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271889.910730:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586962048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271889.910757:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586962048:12345-0@lo:400:kworker.0 Request processed in 27us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271889.910763:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788271889.910793:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788271889.910830:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6f7b3ce00 x1875138586962048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271889.910857:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586962048:0@lo:400:kworker.0 00010000:00080000:0.0:1788271889.910870:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6f7b3c380 x1875138586961920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271889.910879:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586961920:0@lo:400:kworker.0 00000100:00100000:0.0:1788271889.910986:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b79826ef-d055-4784-972d-a5e369371347:3279:1875138586961536:0@lo:400:kworker.0 00000100:00080000:2.0:1788271889.914189:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271889.914206:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586956928:0@lo:8:kworker.0 00000100:00100000:2.0:1788271889.914258:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586961664:0@lo:8:kworker.0 00000100:00100000:2.0:1788271889.914374:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271889.914409:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586961792:0@lo:8:kworker.0 00000100:00100000:2.0:1788271889.914451:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271889.914661:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961664 00000100:00100000:0.0:1788271889.914672:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961664 00000100:00100000:0.0:1788271889.914710:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586961792 00000100:00100000:0.0:1788271889.914712:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586961792 00000100:00100000:0.0:1788271889.914725:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271889.914735:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875138586961664:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788271889.914769:0:15105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:0.0:1788271889.914810:0:15105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f836d 00002000:00100000:0.0:1788271889.914827:0:15105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ab6ee921000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788271889.914832:0:15105:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788271889.914835:0:15105:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788271889.915248:0:15105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788271889.915281:0:15105:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee926800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271889.915370:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875138586961664:12345-0@lo:8:kworker.0 Request processed in 635us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271889.915378:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271889.915402:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271889.915407:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875138586961792:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788271889.915444:0:15105:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788271889.915728:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875138586961792:12345-0@lo:8:kworker.0 Request processed in 319us (1274us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788271889.915735:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788271889.915822:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6f7b3c700 x1875138586961664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271889.915835:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271889.915847:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788271889.915857:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788271889.915864:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788271889.915867:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee0e9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788271889.915935:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788271889.915942:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586961664:0@lo:8:kworker.0 00000100:00080000:0.0:1788271889.915958:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271889.915962:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788271889.915965:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586961792:0@lo:8:kworker.0 00000100:00100000:0.0:1788271889.916123:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586962176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271889.916166:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788271889.916182:0:14440:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788271889.916219:0:14441:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788271889.916248:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875138586962304:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788271889.916282:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271889.916302:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6d99b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271889.916337:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962176 00000100:00100000:3.0:1788271889.916344:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962176 00000100:00100000:3.0:1788271889.916448:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271889.916459:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586962176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271889.916495:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271889.916611:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875138586962176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271889.916627:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788271889.916658:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271889.916695:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962304 00000100:00100000:3.0:1788271889.916700:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962304 00000100:00100000:3.0:1788271889.916726:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271889.916734:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14441:x1875138586962304:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788271889.916863:0:14440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 453098448820ns, next at 0ns, rc = 0 00002000:00080000:3.0:1788271889.919387:0:15105:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788271889.919402:0:15105:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788271889.919409:0:15105:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:0.0:1788271889.919880:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6f79b7480 x1875138586962176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271889.919915:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586962176:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1788271889.938065:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.938082:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938105:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.938123:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.938131:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938155:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938169:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938178:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938202:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.938217:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.938224:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938233:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.938239:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938250:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938270:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938290:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7aa5441/0xbeb05ca97b5f8374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938310:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.938312:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.938314:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.938918:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.938926:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938937:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.938941:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.938946:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938956:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938964:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938972:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.938991:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.939003:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.939014:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939020:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375a00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.939024:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939031:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939043:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939050:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644b5f88/0xbeb05ca97b5f837b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939065:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.939067:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.939068:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.939511:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.939518:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939526:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.939529:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.939533:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939554:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939562:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939570:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939585:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.939595:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.939600:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939607:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.939611:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939618:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939628:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939635:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a830987/0xbeb05ca97b5f8382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.939654:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.939655:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.939657:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.940078:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.940086:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940095:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.940099:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.940104:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940115:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940124:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940133:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940149:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.940157:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.940161:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940182:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.940186:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940194:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940206:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940213:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfe546f9/0xbeb05ca97b5f8389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940236:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.940238:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.940240:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.940675:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.940683:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940693:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.940697:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.940702:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940712:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940728:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940737:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940753:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.940764:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.940769:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940777:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.940781:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940790:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940801:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940809:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d49894e6/0xbeb05ca97b5f8390 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.940824:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.940831:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.940833:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.941236:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.941242:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941252:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.941255:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.941260:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941269:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941279:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941286:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941305:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.941315:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.941319:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941327:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.941330:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941800:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941817:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941826:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ef66176/0xbeb05ca97b5f8397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.941843:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.941845:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.941847:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.943369:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.943382:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.943399:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.943404:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.943434:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.943452:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.943463:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.943482:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.943507:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788271889.943975:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.943981:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.943990:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.943993:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.943997:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944007:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944016:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944023:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944040:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788271889.944055:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271889.944062:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944077:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff375e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.944083:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944092:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944109:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944117:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffa4cc44/0xbeb05ca97b5f839e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944137:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.944141:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944147:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.944151:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944159:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944168:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944183:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f2305de/0xbeb05ca97b5f83a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944197:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.944199:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.944201:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.944646:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.944653:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944663:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.944666:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.944670:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944680:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944689:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944697:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944713:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.944721:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.944733:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944741:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ff374e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.944744:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944753:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944764:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944773:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f0fc1f7/0xbeb05ca97b5f83ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.944788:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.944790:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.944792:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.945178:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.945184:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945193:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.945197:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.945201:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945222:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945231:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945240:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945254:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.945262:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.945266:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945273:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fc200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.945277:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945285:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945296:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945304:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a7ea1cd/0xbeb05ca97b5f83b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945325:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.945327:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.945329:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.945747:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.945754:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945763:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.945766:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.945770:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945778:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945786:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945793:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945807:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.945814:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.945818:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945836:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fc000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.945841:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945849:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945860:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945869:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb1dfe55/0xbeb05ca97b5f83ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.945882:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.945884:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.945885:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.946340:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788271889.946530:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.950623:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950657:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.950664:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.950672:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950705:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950749:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950759:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950790:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.950821:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.950829:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950838:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.950844:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950855:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950877:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950885:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fcf5939/0xbeb05ca97b5f83c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.950910:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.950920:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.950922:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.951726:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.951735:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.951748:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.951752:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.951758:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.951770:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.951780:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.951789:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.951822:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788271889.952219:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.952225:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952235:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.952238:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.952243:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952261:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952270:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952277:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952294:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788271889.952309:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271889.952314:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952322:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.952327:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952338:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952363:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952372:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6adc061/0xbeb05ca97b5f83c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952400:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.952404:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952435:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fca00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.952439:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952449:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952460:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952469:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf825cd/0xbeb05ca97b5f83cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952483:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.952484:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.952486:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.952881:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.952887:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952896:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.952906:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.952910:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952920:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952929:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952937:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952954:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.952962:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.952965:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952973:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.952977:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952985:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.952997:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953016:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018a40282/0xbeb05ca97b5f83d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953031:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.953033:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.953035:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.953492:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.953498:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953508:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.953512:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.953516:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953527:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953536:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953544:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953560:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.953569:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.953578:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953586:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6a00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.953590:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953599:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953611:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953619:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f83dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.953634:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.953637:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.953638:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.954035:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.954042:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954051:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.954054:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.954058:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954079:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954088:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954096:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954111:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.954121:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.954125:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954132:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.954136:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954143:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954154:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954162:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f83e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.954183:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.954185:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.954186:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271889.957791:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.960369:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.960385:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960408:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.960445:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.960453:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960471:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960484:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960493:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960538:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.960550:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.960558:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960581:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.960588:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960599:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960620:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960629:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f07732a/0xbeb05ca97b5f83eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.960649:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.960651:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.960653:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.961222:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.961230:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961241:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.961245:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.961250:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961262:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961280:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961289:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961313:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.961324:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.961329:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961337:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.961342:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961362:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961375:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961384:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2108e0/0xbeb05ca97b5f83f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.961400:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.961408:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.961410:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.962017:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.962026:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962038:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.962041:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.962046:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962056:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962066:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962074:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962095:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.962104:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.962109:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962117:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.962122:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962142:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962154:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962161:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000209edb23/0xbeb05ca97b5f83f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962177:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.962179:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.962181:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.962641:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.962648:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962658:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.962662:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.962667:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962677:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962687:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962786:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962805:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.962816:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.962821:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962829:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.962833:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962842:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962854:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962862:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.962877:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.962879:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.962881:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.963293:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.963307:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.963317:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.963321:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.963326:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.963337:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965183:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965213:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965237:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271889.965255:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271889.965262:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965271:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271889.965278:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965291:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965326:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965335:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8407 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.965372:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.965375:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.965377:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.966186:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.966196:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966211:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.966216:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.966223:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966238:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966249:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966258:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966361:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788271889.966816:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.966824:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966835:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.966839:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.966843:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966854:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966864:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.966872:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967137:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271889.967148:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967157:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271889.967162:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967172:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967194:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967202:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097fe934d/0xbeb05ca97b5f840e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967239:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271889.967243:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967250:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271889.967253:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967260:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967270:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967277:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271889.967279:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271889.967281:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.967321:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788271889.967326:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f8415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.967796:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.968002:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.968010:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968030:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.968034:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.968040:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968053:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968062:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968070:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968129:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788271889.968597:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.968604:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968613:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.968616:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.968621:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968630:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968650:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.968657:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976546:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271889.976572:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976590:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271889.976596:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976640:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976672:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976680:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090652fbc/0xbeb05ca97b5f841c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976803:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271889.976809:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976816:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271889.976820:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976827:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976838:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.976847:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271889.976849:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271889.976859:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.977144:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788271889.977154:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec88d785/0xbeb05ca97b5f8423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271889.977834:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271889.980455:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271889.980478:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.980504:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788271889.980510:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271889.980520:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.980542:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.980556:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.980584:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271889.980608:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271889.982824:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271889.982841:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.982858:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271889.982865:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.982877:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.982905:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.982913:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8972582/0xbeb05ca97b5f842a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271889.982940:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271889.982943:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271889.982945:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788271889.983925:0:15105:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788271889.984068:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14441:x1875138586962304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67328us (67777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271889.984081:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271889.984173:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875138586962304:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788271889.984194:0:14441:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788271889.984256:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875138586962432:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788271889.984299:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271889.984363:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6cb5586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271889.984394:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962432 00000100:00100000:0.0:1788271889.984402:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962432 00000100:00100000:0.0:1788271889.984465:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271889.984475:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14441:x1875138586962432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788271889.984524:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788271890.005302:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14441:x1875138586962432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 20814us (20990us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788271890.005323:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271890.005450:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875138586962432:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788271890.005473:0:14441:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:2.0:1788271890.009058:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788271890.099819:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271891.123778:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788271891.296593:0:15823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788271891.296599:0:15823:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788271891.296749:0:15823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab6c8228800 00000020:01000004:2.0:1788271891.296771:0:15823:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788271891.296791:0:15823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788271891.296836:0:15823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ab5c11099b8) 00000020:00000080:2.0:1788271891.296859:0:15823:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788271891.320313:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788271891.320998:0:15823:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788271891.321832:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788271891.322129:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788271891.322376:0:15823:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788271891.322775:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 515: rc = 0 00100000:10000000:2.0:1788271891.322875:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 515: rc = 0 00100000:10000000:2.0:1788271891.322970:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:2.0:1788271891.323585:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 651: rc = 0 00100000:10000000:2.0:1788271891.323868:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 651: rc = 0 00100000:10000000:2.0:1788271891.324123:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 651: rc = 0 00100000:10000000:2.0:1788271891.324641:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 651: rc = 0 00100000:10000000:2.0:1788271891.324908:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 651: rc = 0 00100000:10000000:2.0:1788271891.325171:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 651: rc = 0 00000020:00000080:2.0:1788271891.326031:0:15823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788271891.326048:0:15823:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788271891.326063:0:15823:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbeb05ca97b5f8438 00000020:01000004:2.0:1788271891.326074:0:15823:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788271891.326104:0:15823:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788271891.326108:0:15823:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788271891.326116:0:15823:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788271891.326147:0:15823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788271891.326152:0:15823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788271891.334671:0:15823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788271891.334727:0:15823:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.101@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788271891.334732:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788271891.334734:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271891.334736:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271891.334737:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271891.334739:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271891.334740:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271891.334742:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271891.334744:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271891.334749:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271891.334753:0:15823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788271891.334755:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271891.334757:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271891.334758:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271891.334759:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271891.334760:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271891.334761:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271891.334762:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271891.334763:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271891.334764:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271891.334798:0:15823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788271891.334823:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962560:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788271891.334918:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.335031:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.335080:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962560 00000100:00100000:0.0:1788271891.335088:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962560 00000100:00100000:0.0:1788271891.335156:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271891.335168:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:15823:x1875138586962560:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788271891.335225:0:14410:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788271891.335229:0:14410:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788271891.335233:0:14410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788271891.342828:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:15823:x1875138586962560:12345-0@lo:253:mount.lustre.0 Request processed in 7645us (7893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271891.342852:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788271891.342970:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788271891.342990:0:15823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788271891.342995:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788271891.342997:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788271891.342999:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271891.343000:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271891.343002:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271891.343004:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271891.343025:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271891.343028:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271891.343029:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788271891.343056:0:15823:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab6c8228800 from lustre-OST0001 10000000:01000000:1.0:1788271891.343093:0:15823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788271891.343097:0:15823:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788271891.343106:0:15823:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab6e5924d28 local copy 00010000:00010000:1.0:1788271891.343120:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271891.343410:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271891.343484:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271891.343581:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6caaa49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.343630:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962688 00000100:00100000:0.0:1788271891.343639:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962688 00000100:00100000:0.0:1788271891.343794:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788271891.343807:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:15823:x1875138586962688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271891.344159:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:15823:x1875138586962688:12345-0@lo:501:mount.lustre.0 Request processed in 354us (673us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271891.344168:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788271891.344256:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962688:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788271891.344275:0:15823:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788271891.344492:0:15823:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788271891.344501:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.344512:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19e00/0xbeb05ca97b5f81e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f81ec expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271891.344540:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab6c8228800 10000000:01000000:2.0:1788271891.344545:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788271891.344551:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788271891.344553:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271891.344565:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788271891.344568:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788271891.344603:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024ba00/0xbeb05ca97b5f843f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.344611:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024ba00/0xbeb05ca97b5f843f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.344622:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024ba00/0xbeb05ca97b5f843f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271891.344640:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271891.344791:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.344835:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271891.344914:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962816 00000100:00100000:3.0:1788271891.344921:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962816 00000100:00100000:3.0:1788271891.345001:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788271891.345011:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+16:15823:x1875138586962816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271891.345023:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271891.345038:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f843f expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271891.345063:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f843f expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271891.345073:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee18a00/0xbeb05ca97b5f8446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f843f expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271891.345083:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18a00, rc 0) 00000100:00100000:3.0:1788271891.345131:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586962816:12345-0@lo:101:mount.lustre.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271891.345139:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788271891.345274:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271891.345290:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024ba00/0xbeb05ca97b5f843f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8446 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.345300:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024ba00/0xbeb05ca97b5f843f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8446 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271891.346138:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788271891.347344:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271891.347870:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788271891.347924:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788271891.347960:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788271891.348011:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788271891.348052:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788271891.348090:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788271891.348162:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788271891.348178:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788271891.348302:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271891.348405:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.348583:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271891.348747:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586962944 00000100:00100000:3.0:1788271891.348764:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586962944 00000100:00100000:3.0:1788271891.348870:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788271891.348884:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586962944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271891.349384:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586962944:12345-0@lo:501:mount.lustre.0 Request processed in 502us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271891.349394:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271891.349572:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586962944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271891.349626:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271891.349682:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.349861:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.349967:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963072 00000100:00100000:0.0:1788271891.349974:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963072 00000100:00100000:0.0:1788271891.350014:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788271891.350023:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586963072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271891.350377:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586963072:12345-0@lo:503:mount.lustre.0 Request processed in 354us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.350384:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271891.350524:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963072:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788271891.351176:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271891.351267:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271891.351335:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.351370:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.351540:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963200 00000100:00100000:0.0:1788271891.351546:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963200 00000100:00100000:0.0:1788271891.351585:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788271891.351594:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586963200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271891.351845:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586963200:12345-0@lo:502:mount.lustre.0 Request processed in 252us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.351863:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271891.352036:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271891.352305:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788271891.352375:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788271891.352434:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788271891.352519:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788271891.352560:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788271891.352595:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788271891.352643:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788271891.352748:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788271891.352813:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788271891.352851:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271891.352902:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.352933:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.353010:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963328 00000100:00100000:0.0:1788271891.353016:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963328 00000100:00100000:0.0:1788271891.353051:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788271891.353060:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586963328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271891.353247:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586963328:12345-0@lo:502:mount.lustre.0 Request processed in 187us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.353255:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271891.353456:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271891.353527:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788271891.353537:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788271891.354629:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788271891.354641:0:15824:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788271891.354649:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271891.354652:0:15824:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788271891.354658:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271891.354740:0:15824:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ab5c110cd28) 00000020:00000080:2.0:1788271891.354771:0:15824:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788271891.354779:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271891.354883:0:15824:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6c8228800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788271891.354892:0:15824:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271891.354902:0:15824:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbeb05ca97b5f8454 00010000:00010000:2.0:1788271891.359400:0:15824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788271891.360044:0:15824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788271891.361957:0:15824:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788271891.363484:0:15824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788271891.363500:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271891.363511:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271891.363514:0:15824:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788271891.363517:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271891.363522:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271891.363523:0:15824:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271891.363526:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271891.363528:0:15824:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788271891.363530:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271891.363532:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271891.363534:0:15824:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788271891.363536:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271891.363539:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271891.363540:0:15824:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788271891.363550:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788271891.363624:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271891.363627:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271891.363628:0:15824:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788271891.363632:0:15824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788271891.372430:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788271891.372488:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788271891.372600:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024ba00/0xbeb05ca97b5f843f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8446 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271891.372617:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024ba00/0xbeb05ca97b5f843f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8446 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271891.372653:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c8228800 from 1 10000000:01000000:1.0:1788271891.372657:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271891.372711:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271891.372721:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271891.372737:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271891.372957:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788271891.373053:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271891.373106:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6caaa4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.373657:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963456 00000100:00100000:0.0:1788271891.373733:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963456 00000100:00100000:0.0:1788271891.373806:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788271891.373819:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:15823:x1875138586963456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271891.373841:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271891.373860:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f845b expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271891.373892:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271891.373905:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271891.373916:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ea2d7600, rc 0) 00000100:00100000:0.0:1788271891.373979:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963456:12345-0@lo:101:mount.lustre.0 Request processed in 162us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.373986:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788271891.374443:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271891.374465:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271891.374477:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271891.376756:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788271891.377182:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271891.377531:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788271891.377571:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788271891.377622:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788271891.377629:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788271891.377790:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271891.377889:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.377995:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271891.378536:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963584 00000100:00100000:3.0:1788271891.378546:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963584 00000100:00100000:3.0:1788271891.378632:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788271891.378644:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271891.379074:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963584:12345-0@lo:501:mount.lustre.0 Request processed in 430us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271891.379084:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788271891.379179:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271891.379232:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271891.379286:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.379448:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.379647:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963712 00000100:00100000:0.0:1788271891.379661:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963712 00000100:00100000:0.0:1788271891.379768:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788271891.379777:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6caa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271891.380139:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6caa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963712:12345-0@lo:503:mount.lustre.0 Request processed in 362us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.380146:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788271891.380340:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963712:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788271891.381148:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271891.381239:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271891.381307:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.381398:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271891.381621:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963840 00000100:00100000:1.0:1788271891.381630:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963840 00000100:00100000:0.0:1788271891.381860:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788271891.381876:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271891.382138:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963840:12345-0@lo:502:mount.lustre.0 Request processed in 267us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.382146:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271891.382260:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788271891.382749:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788271891.382811:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788271891.382863:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788271891.382901:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788271891.382933:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788271891.382976:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788271891.383009:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788271891.383039:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788271891.383081:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271891.383147:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271891.383193:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6caaa4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.383267:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586963968 00000100:00100000:0.0:1788271891.383274:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586963968 00000100:00100000:0.0:1788271891.383334:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788271891.383344:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271891.383544:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586963968:12345-0@lo:502:mount.lustre.0 Request processed in 201us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.383552:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788271891.383767:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586963968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788271891.383860:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788271891.383875:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788271891.384984:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271891.384996:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271891.384998:0:15828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788271891.385004:0:15828:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c8228800 00000020:00000080:1.0:1788271891.385005:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271891.385012:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271891.385014:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271891.385014:0:15828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788271891.385016:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271891.385017:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271891.385018:0:15828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788271891.385019:0:15828:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab6c8228800 00000020:00000080:1.0:1788271891.385020:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271891.385114:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271891.385117:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271891.385118:0:15828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788271891.385119:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271891.385121:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271891.385121:0:15828:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788271891.385123:0:15828:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab6c8228800 00000020:00000080:1.0:1788271891.385125:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271891.386481:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271891.386492:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271891.386506:0:15828:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788271891.386511:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788271891.386789:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788271891.386820:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271891.386851:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.386879:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271891.386939:0:15823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788271891.386942:0:15823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab6c8228800 10000000:01000000:2.0:1788271891.386946:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab6c8228800 10000000:01000000:2.0:1788271891.386952:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271891.386959:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab6c8228800 from 1 10000000:01000000:2.0:1788271891.386962:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788271891.387014:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f8469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.387023:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f8469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.387036:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f8469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271891.387067:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271891.387159:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.387216:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6fef49f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271891.387850:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964096 00000100:00100000:3.0:1788271891.387860:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964096 00000100:00100000:3.0:1788271891.387920:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788271891.387931:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586964096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271891.387950:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271891.387966:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f8470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f8469 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271891.387995:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f8470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8469 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271891.388006:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee18000/0xbeb05ca97b5f8470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8469 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271891.388016:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18000, rc 0) 00000100:00100000:3.0:1788271891.388081:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964096:12345-0@lo:101:mount.lustre.0 Request processed in 151us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271891.388089:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788271891.388111:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271891.388128:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f8469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8470 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271891.388139:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f8469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8470 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271891.389234:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788271891.389765:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271891.390055:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788271891.390104:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788271891.390139:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788271891.390183:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788271891.390218:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788271891.390266:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788271891.390302:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788271891.390351:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788271891.390404:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788271891.390464:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788271891.390497:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788271891.390542:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788271891.390579:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788271891.390612:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788271891.390659:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788271891.390695:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788271891.390728:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788271891.390778:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788271891.390812:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788271891.390842:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788271891.390887:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788271891.390921:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788271891.390954:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788271891.391021:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788271891.391055:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788271891.391087:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788271891.391133:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788271891.391167:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788271891.391198:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788271891.391255:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788271891.391292:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788271891.391773:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788271891.391826:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788271891.391867:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788271891.391902:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788271891.391945:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788271891.391965:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788271891.392025:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788271891.392030:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788271891.392137:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271891.392232:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271891.392285:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271891.392286:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964224 00000100:00100000:1.0:1788271891.392295:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964224 00000100:00100000:1.0:1788271891.392366:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271891.392379:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271891.392762:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964224:12345-0@lo:501:mount.lustre.0 Request processed in 383us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271891.392796:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271891.392833:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271891.392833:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271891.392877:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271891.392906:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271891.392910:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964352 00000100:00100000:1.0:1788271891.392914:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964352 00000100:00100000:1.0:1788271891.392942:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788271891.392948:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964352:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271891.393662:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964352:12345-0@lo:503:mount.lustre.0 Request processed in 712us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271891.393670:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271891.393846:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964352:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788271891.394991:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271891.395091:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271891.395234:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271891.395313:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7015fc300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.395365:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964480 00000100:00100000:0.0:1788271891.395374:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964480 00000100:00100000:0.0:1788271891.395494:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788271891.395507:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271891.395913:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964480:12345-0@lo:502:mount.lustre.0 Request processed in 408us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.395922:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271891.396007:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271891.396287:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788271891.396353:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788271891.396401:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788271891.396475:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788271891.396514:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788271891.396565:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788271891.396603:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788271891.396635:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788271891.396841:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788271891.396884:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788271891.396919:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788271891.396969:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788271891.397005:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788271891.397036:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788271891.397079:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788271891.397113:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788271891.397144:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788271891.397192:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788271891.397228:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788271891.397257:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788271891.397301:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788271891.397349:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788271891.397381:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788271891.397643:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788271891.397772:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788271891.397810:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788271891.397862:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788271891.397898:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788271891.397930:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788271891.397982:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788271891.398015:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788271891.398045:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788271891.398073:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788271891.398118:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788271891.398154:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788271891.398228:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788271891.398266:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788271891.398296:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788271891.398356:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788271891.398394:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788271891.398485:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271891.398587:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271891.398641:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.398794:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964608 00000100:00100000:0.0:1788271891.398809:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964608 00000100:00100000:0.0:1788271891.398876:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788271891.398888:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271891.399293:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586964608:12345-0@lo:502:mount.lustre.0 Request processed in 406us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.399302:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788271891.405498:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586964608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271891.406853:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788271891.406879:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788271891.408161:0:15833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788271891.408185:0:15833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ab5c1108000) 00000020:00000080:2.0:1788271891.408216:0:15833:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788271891.408319:0:15833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab6c8228800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788271891.408341:0:15833:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab6c8228800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788271891.408344:0:15833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab6c8228800 3 00010000:00080000:2.0:1788271891.408385:0:15833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6c8227800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.101@tcp at head 00010000:00010000:2.0:1788271891.411634:0:15833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788271891.412041:0:15833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788271891.412092:0:15833:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788271891.412108:0:15833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbeb05ca97b5f847e 00000100:00080000:2.0:1788271891.412122:0:15833:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271891.412129:0:15833:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6c8227800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271891.412175:0:15833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ffad3480 x1875138586964736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271891.412211:0:15833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788271891.412383:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875138586964736:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788271891.412583:0:14475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271891.412588:0:14475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788271891.412590:0:14475:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271891.412595:0:14475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1788271891.412600:0:14475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788271891.412604:0:14475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab6c3184000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1788271891.412620:0:14475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6ffad1180 x1875138586964992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271891.412690:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586964864:0@lo:400:kworker.0 00000100:00100000:3.0:1788271891.412769:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271891.412913:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964864 00000100:00100000:1.0:1788271891.412922:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964864 00000100:00100000:1.0:1788271891.412997:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788271891.413025:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271891.413055:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1875138586964864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271891.413122:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271891.413167:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586964992:0@lo:8:kworker.0 00000100:00100000:0.0:1788271891.413194:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271891.413225:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586965120:0@lo:400:kworker.0 00000100:00100000:0.0:1788271891.413250:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271891.413266:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271891.413271:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586965248:0@lo:400:kworker.0 00000100:00100000:0.0:1788271891.413289:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271891.413316:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788271891.413335:0:15107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788271891.413350:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964736 00000100:00100000:0.0:1788271891.413353:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964736 00000100:00100000:0.0:1788271891.413369:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586965120 00000100:00100000:0.0:1788271891.413371:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586965120 00000100:00100000:0.0:1788271891.413389:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586965248 00000100:00100000:0.0:1788271891.413391:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586965248 00000100:00100000:0.0:1788271891.413434:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271891.413441:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586965120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271891.413481:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586965120:12345-0@lo:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.413500:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271891.413517:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271891.413523:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586965248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271891.413554:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875138586965248:12345-0@lo:400:kworker.0 Request processed in 31us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.413560:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271891.413572:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271891.413576:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875138586964736:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788271891.413601:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:0.0:1788271891.413643:0:14418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbeb05ca97b5f8485 00000004:00100000:0.0:1788271891.413661:0:14418:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788271891.413835:0:14418:0:(import.c:65:import_set_state_nolock()) ffff8ab6ee930000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271891.413878:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875138586964736:12345-0@lo:38:llog_process_th.0 Request processed in 300us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271891.413886:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788271891.413934:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ffad1c00 x1875138586965248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271891.413950:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875138586965248:0@lo:400:kworker.0 00010000:00080000:0.0:1788271891.413962:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ffad2a00 x1875138586965120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271891.413969:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586965120:0@lo:400:kworker.0 00010000:00080000:0.0:1788271891.414000:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab6ffad3480 x1875138586964736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271891.414019:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271891.414027:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788271891.414035:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788271891.414040:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788271891.414042:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c8227800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271891.414048:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875138586964736:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788271891.414065:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271891.414456:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586964992 00000100:00100000:0.0:1788271891.414462:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586964992 00000100:00100000:0.0:1788271891.414490:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788271891.414499:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271891.414506:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1875138586964992:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788271891.414560:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1875138586964992:12345-0@lo:8:kworker.0 Request processed in 53us (1365us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788271891.414566:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271891.414597:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271891.414602:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271891.414606:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788271891.414610:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586964992:0@lo:8:kworker.0 00000100:00100000:1.0:1788271891.415055:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1875138586964864:12345-0@lo:400:kworker.0 Request processed in 2002us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271891.415065:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271891.415114:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586964864:0@lo:400:kworker.0 00000040:00080000:0.0:1788271891.415591:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788271891.415772:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788271891.415805:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788271891.415825:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f8469 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8470 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271891.415847:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024aa00/0xbeb05ca97b5f8469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8470 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788271891.415904:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788271891.415907:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788271891.415909:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271891.415910:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271891.415912:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271891.415913:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271891.415915:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271891.415918:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271891.415920:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271891.415925:0:15823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788271891.415927:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788271891.415929:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788271891.415930:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271891.415931:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271891.415932:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271891.415933:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271891.415934:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271891.415936:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271891.415937:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271891.415965:0:15823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788271891.415986:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586965376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788271891.416065:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271891.416111:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6f7403780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271891.416222:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586965376 00000100:00100000:0.0:1788271891.416229:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586965376 00000100:00100000:0.0:1788271891.416282:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788271891.416292:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:15823:x1875138586965376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788271891.416333:0:14412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788271891.416359:0:14412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788271891.445182:0:14412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788271891.445211:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788271891.445281:0:14434:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788271891.445289:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788271891.445335:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271891.445364:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271891.445374:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271891.445469:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271891.445488:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 19 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271891.445508:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875138586965504:0@lo:104: 00000100:00100000:0.0:1788271891.445599:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271891.445653:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9292300 going to sleep for 11 seconds 00000100:00100000:1.0:1788271891.445785:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586965504 00000100:00100000:1.0:1788271891.445796:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586965504 00000100:00100000:1.0:1788271891.445863:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271891.445874:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b79826ef-d055-4784-972d-a5e369371347+3:14434:x1875138586965504:12345-0@lo:104: 00010000:00010000:1.0:1788271891.445891:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271891.447565:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271891.447584:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b79826ef-d055-4784-972d-a5e369371347+3:14434:x1875138586965504:12345-0@lo:104: Request processed in 1707us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271891.447598:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788271891.447754:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271891.447765:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.447777:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a800 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:2.0:1788271891.447782:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.447809:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271891.447818:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271891.447825:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271891.447883:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.447890:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271891.447920:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.447928:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab70024a800/0xbeb05ca97b5f835f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8366 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.447950:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271891.447952:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271891.447954:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271891.447983:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586965632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271891.448057:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271891.448128:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586965632 00000100:00100000:2.0:1788271891.448138:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586965632 00010000:00010000:2.0:1788271891.448175:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 20 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271891.448210:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271891.448222:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b79826ef-d055-4784-972d-a5e369371347+20:3278:x1875138586965632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271891.448248:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271891.448255:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 20 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448269:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 20 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448294:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448304:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788271891.448335:0:14405:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003048124s 00010000:00010000:2.0:1788271891.448341:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448349:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448356:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448362:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448367:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271891.448372:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448379:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448394:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448406:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271891.448472:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b79826ef-d055-4784-972d-a5e369371347+20:3278:x1875138586965632:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271891.448479:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271891.448531:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586965632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271891.448574:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee6800/0xbeb05ca97b5f8366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f835f expref: 19 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271891.448584:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875138586965504:0@lo:104: 00010000:00010000:2.0:1788271891.448607:0:14434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448616:0:14434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448622:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271891.448628:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6ea2d6000/0xbeb05ca97b5f848c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271891.459806:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+18:15823:x1875138586965376:12345-0@lo:253:mount.lustre.0 Request processed in 43502us (43727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271891.459825:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788271891.460095:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b79826ef-d055-4784-972d-a5e369371347:15823:1875138586965376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788271891.460119:0:15823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788271891.460124:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788271891.460126:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788271891.460127:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271891.460128:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271891.460129:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271891.460131:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271891.460133:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271891.460135:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271891.460138:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788271891.460162:0:15823:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788271891.465315:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788271891.465532:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788271891.465702:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788271891.465857:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788271891.465992:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788271891.466223:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788271891.468338:0:15823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788271891.586950:0:15823:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788271891.586965:0:15823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788271891.587514:0:15823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788271891.587601:0:15823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788271891.587622:0:15823:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788271891.587666:0:15823:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788271892.146642:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788271892.789306:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788271892.789317:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab6f73f3800 from 8 10000000:01000000:3.0:1788271892.789323:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788271892.789388:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18600/0xbeb05ca97b5f8493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271892.789403:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18600/0xbeb05ca97b5f8493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271892.789436:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18600/0xbeb05ca97b5f8493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271892.789473:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586965760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271892.789571:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271892.789635:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ee089000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271892.789849:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586965760 00000100:00100000:0.0:1788271892.789858:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586965760 00000100:00100000:0.0:1788271892.789925:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788271892.789935:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+18:14416:x1875138586965760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271892.789965:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271892.789981:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6ea2d7a00/0xbeb05ca97b5f849a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f8493 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271892.790007:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6ea2d7a00/0xbeb05ca97b5f849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8493 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271892.790018:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6ea2d7a00/0xbeb05ca97b5f849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8493 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271892.790029:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6ea2d7a00, rc 0) 00000100:00100000:0.0:1788271892.790083:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586965760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271892.790091:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788271892.791599:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586965760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271892.791633:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18600/0xbeb05ca97b5f8493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f849a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271892.792117:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18600/0xbeb05ca97b5f8493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f849a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271892.792344:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586965888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788271892.793133:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271892.793371:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586965888 00000100:00100000:1.0:1788271892.793383:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586965888 00000100:00100000:1.0:1788271892.793499:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271892.793512:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586965888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788271892.793546:0:14412:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788271892.793569:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788271892.793572:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788271892.793669:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ee089000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271892.798883:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586965888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 5361us (5738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271892.799057:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586965888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788271892.799146:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788271892.799158:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18600/0xbeb05ca97b5f8493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f849a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271892.799171:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18600/0xbeb05ca97b5f8493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f849a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271892.804891:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000001:00080000:0.0:1788271893.106450:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788271893.106531:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788271893.170588:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271894.196038:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271895.026674:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271895.026709:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586966016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271895.026783:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271895.027012:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966016 00000100:00100000:0.0:1788271895.027021:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966016 00000100:00100000:0.0:1788271895.027089:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271895.027101:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586966016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271895.027135:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271895.027180:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586966016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271895.027187:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788271895.027246:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271895.027329:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788271895.027351:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586966016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788271895.234499:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.247002:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788271896.567367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271896.567373:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788271896.567377:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271896.567389:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab6c3184000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1788271896.567425:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6f79b6300 x1875138586966400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271896.567487:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586966272:0@lo:400:kworker.0 00000100:00100000:3.0:1788271896.567551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271896.567621:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788271896.567628:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586966144:0@lo:400:kworker.0 00000100:00100000:3.0:1788271896.567671:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271896.567976:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586966784:0@lo:400:kworker.0 00000100:00100000:3.0:1788271896.568008:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271896.568043:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586966400:0@lo:8:kworker.0 00000100:00100000:3.0:1788271896.568068:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271896.568096:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586966528:0@lo:400:kworker.0 00000100:00100000:3.0:1788271896.568118:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271896.568136:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271896.568142:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f79b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586966656:0@lo:400:kworker.0 00000100:00100000:3.0:1788271896.568162:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271896.568189:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966272 00000100:00100000:3.0:1788271896.568196:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966272 00000100:00100000:3.0:1788271896.568246:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966400 00000100:00100000:3.0:1788271896.568249:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966400 00000100:00100000:0.0:1788271896.568298:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966784 00000100:00100000:0.0:1788271896.568301:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966784 00000100:00100000:0.0:1788271896.568334:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966528 00000100:00100000:0.0:1788271896.568337:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966528 00000100:00100000:0.0:1788271896.568358:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966656 00000100:00100000:0.0:1788271896.568361:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966656 00000100:00100000:0.0:1788271896.568377:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271896.568387:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586966784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271896.568460:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586966784:12345-0@lo:400:kworker.0 Request processed in 75us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271896.568468:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271896.568484:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271896.568491:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586966528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271896.568520:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875138586966528:12345-0@lo:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271896.568527:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271896.568539:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271896.568546:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586966656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271896.568571:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586966656:12345-0@lo:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271896.568590:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788271896.568607:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271896.569292:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271896.569303:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586966272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271896.569346:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586966272:12345-0@lo:400:kworker.0 Request processed in 46us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271896.569353:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271896.569368:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271896.569373:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1875138586966400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788271896.569397:0:15107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1788271896.569440:0:15107:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbeb05ca97b5f84a1 00002000:00100000:3.0:1788271896.569455:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ab6e5822000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788271896.569460:0:15107:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788271896.569471:0:15107:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788271896.573628:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788271896.573668:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8ab6e5821800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271896.573936:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3277:x1875138586966400:12345-0@lo:8:kworker.0 Request processed in 4558us (5864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271896.573948:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271896.574042:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966144 00000100:00100000:2.0:1788271896.574050:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966144 00000100:00100000:2.0:1788271896.574094:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788271896.574103:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3281:x1875138586966144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271896.574143:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3281:x1875138586966144:12345-0@lo:400:kworker.0 Request processed in 41us (6472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271896.574150:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788271896.574226:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586966144:0@lo:400:kworker.0 00010000:00080000:2.0:1788271896.574262:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b4000 x1875138586966784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271896.574274:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586966784:0@lo:400:kworker.0 00000100:00100000:2.0:1788271896.574287:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586966272:0@lo:400:kworker.0 00010000:00080000:2.0:1788271896.574334:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b5f80 x1875138586966656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271896.574342:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586966656:0@lo:400:kworker.0 00010000:00080000:2.0:1788271896.574370:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b7480 x1875138586966528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271896.574378:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875138586966528:0@lo:400:kworker.0 00010000:00080000:0.0:1788271896.574817:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f79b6300 x1875138586966400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788271896.574832:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788271896.574841:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788271896.574847:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788271896.574860:0:3277:0:(import.c:65:import_set_state_nolock()) ffff8ab6c3184000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788271896.574875:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788271896.574881:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875138586966400:0@lo:8:kworker.0 00000004:00080000:0.0:1788271896.574945:0:14443:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788271896.574966:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875138586967040:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788271896.575008:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271896.575032:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6caaa49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271896.575048:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967040 00000100:00100000:0.0:1788271896.575052:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967040 00000100:00100000:0.0:1788271896.575088:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271896.575098:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14443:x1875138586967040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788271896.577379:0:15106:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788271896.577389:0:15106:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788271896.577395:0:15106:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1788271896.580501:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271896.580529:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586966912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271896.580607:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788271896.581801:0:14442:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788271896.582674:0:14442:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459764259309ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788271896.592089:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586966912 00000100:00100000:0.0:1788271896.592107:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586966912 00000100:00100000:0.0:1788271896.592168:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271896.592181:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875138586966912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271896.592302:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788271896.592840:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875138586966912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 660us (12232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271896.592910:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788271896.592947:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788271896.592983:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6f7b3e300 x1875138586966912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271896.593004:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586966912:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788271896.593463:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.593472:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593500:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.593504:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.593511:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593530:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593541:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593550:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593571:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.593582:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.593588:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593596:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.593601:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593611:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593640:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593648:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.593665:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.593667:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.593669:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.596023:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.596037:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.596052:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.596056:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.596063:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.596077:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.596087:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.596096:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.596140:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271896.596676:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271896.596695:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271896.596706:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:3.0:1788271896.596711:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271896.596721:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271896.596741:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271896.596758:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f84af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271896.596780:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271896.596782:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271896.596784:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.599388:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.599400:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599435:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.599440:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.599446:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599460:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599470:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599478:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599497:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.599510:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.599515:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599523:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.599534:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599543:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599559:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.599567:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.600963:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.600969:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.600972:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.601515:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.601524:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.601538:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.601542:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.601548:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.601562:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.601572:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.603974:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.604828:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788271896.605523:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.605534:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.605553:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.605558:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.605565:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.605579:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.605590:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.605599:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612308:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271896.612322:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612336:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6a00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.612341:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612352:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612377:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612384:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f84bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612440:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271896.612444:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612452:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.612455:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612469:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612480:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.612488:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.612490:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.612492:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.617799:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788271896.617815:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788271896.618620:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.618630:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618645:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.618650:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.618656:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618671:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618695:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618703:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618721:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.618731:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.618736:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618915:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.618920:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618937:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618955:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618962:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f84cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.618978:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.618979:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.618981:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.619386:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.619392:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619401:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.619405:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.619409:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619452:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619461:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619474:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619489:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.619497:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.619501:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619508:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.619511:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619520:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619532:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619540:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f84d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.619553:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.619555:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.619557:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.619790:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.624578:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.624599:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.624617:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.624621:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.624627:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.624642:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.624653:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.624662:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.624682:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.624707:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.624714:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.624722:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.624727:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.624737:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.626987:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.626998:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f84d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.627051:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.627054:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.627057:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.630845:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.630858:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.630875:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.630888:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.630894:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.630909:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.630922:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.630930:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.630962:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.630976:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.630981:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.630989:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.630993:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631003:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631018:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631024:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f84e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631040:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.631042:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.631043:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.631451:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.631456:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631464:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.631471:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.631475:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631483:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631490:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631495:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631506:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.631513:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.631516:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631522:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.631525:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631531:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631540:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631554:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f84e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.631565:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.631567:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.631568:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.633207:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.633220:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633243:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.633248:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.633253:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633284:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633295:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633303:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633398:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.633408:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.633435:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633443:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.633448:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633457:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633486:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633494:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f84ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.633560:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.633563:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.633564:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.637176:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.637189:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637205:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.637210:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.637216:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637257:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637269:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637277:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637295:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.637308:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.637314:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637322:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.637326:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637336:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637352:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637360:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f84f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.637385:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.637387:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.637389:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.638147:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.638155:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.638165:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.638169:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.638174:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.638184:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.638193:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.638201:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.638216:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271896.638225:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271896.640157:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.640197:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271896.640203:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.640213:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.640245:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.640252:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec88d785/0xbeb05ca97b5f84fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.640274:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.640276:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.640278:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788271896.640290:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788271896.641396:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.641405:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641449:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.641454:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.641460:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641486:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641496:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641505:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641530:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271896.641614:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.641621:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.641630:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.641635:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.641644:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.641660:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.641668:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001082e339/0xbeb05ca97b5f8503 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.641694:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.641696:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.641698:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.641894:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.641900:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641909:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.641912:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.641916:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641925:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641934:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641952:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.641972:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271896.642261:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.642266:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642285:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.642288:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642296:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642308:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642315:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3733bb4/0xbeb05ca97b5f850a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788271896.642318:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.642323:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642328:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.642330:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.642331:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788271896.642332:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.642335:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.642338:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.642347:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.642355:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.642361:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.642381:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271896.642436:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.642441:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642448:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.642452:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642460:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642477:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642485:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c867e5/0xbeb05ca97b5f8511 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.642498:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.642500:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.642502:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.649674:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.649687:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.649711:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.649716:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.649721:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.649735:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.649746:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.649755:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.649780:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788271896.650219:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.650226:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650247:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.650251:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.650255:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650264:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650282:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650289:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650309:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271896.650313:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271896.650320:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650329:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.650335:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650345:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650362:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650370:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f488ed0/0xbeb05ca97b5f8518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650398:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.650402:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650409:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7c00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.650429:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650438:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650448:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650455:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d3fd1f6/0xbeb05ca97b5f851f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.650467:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.650469:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.650471:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.650706:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.650711:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.650713:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.650721:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.650724:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.650727:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650736:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650745:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650753:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.650782:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788271896.651136:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.651142:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651149:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.651152:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.651156:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651165:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651172:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651178:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651198:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788271896.651575:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.651580:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651589:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.651597:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.651602:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651613:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651622:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651631:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.651640:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788271896.651993:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.651998:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652006:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.652009:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271896.652010:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788271896.652013:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652016:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652022:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652023:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.652028:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652030:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652036:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652043:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652049:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652050:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788271896.652056:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d2108e0/0xbeb05ca97b5f8526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652079:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788271896.652082:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652089:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7000 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.652092:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652100:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652110:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652117:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f07732a/0xbeb05ca97b5f852d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652129:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271896.652132:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652139:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.652142:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652159:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652169:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652176:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8972582/0xbeb05ca97b5f8534 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652189:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271896.652192:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652198:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.652201:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652208:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652217:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652225:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090652fbc/0xbeb05ca97b5f853b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652259:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.652260:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.652262:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.652433:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.652439:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652447:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.652449:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.652454:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652462:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652470:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652476:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652498:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271896.652507:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.652514:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.652521:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.652529:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.652538:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.652550:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.652558:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097fe934d/0xbeb05ca97b5f8542 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.652572:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.652584:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.652587:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.652874:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.652880:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652892:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.652895:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.652900:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652909:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652917:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.652924:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.652928:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271896.652941:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271896.653504:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.653511:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.653520:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6a00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.653524:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.653534:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.653547:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.653560:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da97f8aa/0xbeb05ca97b5f8549 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.653588:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.653590:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.653592:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.654628:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.654637:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.654648:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.654651:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.654656:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.654666:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.654686:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.654692:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.654721:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271896.654838:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271896.654845:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.654864:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d7800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.654869:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.654877:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.654892:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.654899:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b04c0d00/0xbeb05ca97b5f8550 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.654916:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.654918:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.654919:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.655144:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.655149:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655158:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.655161:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.655165:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655173:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655180:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655187:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655216:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271896.655277:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.655283:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.655290:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6ea2d6200 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.655294:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.655302:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.655312:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.655320:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034557e9f/0xbeb05ca97b5f8557 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.655335:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.655337:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.655339:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.655617:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.655623:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655632:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.655635:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.655639:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655648:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655656:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655663:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.655679:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271896.655837:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271896.655843:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.655921:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd600 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271896.655925:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.655933:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.655945:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.655952:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a40282/0xbeb05ca97b5f855e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271896.655967:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.655969:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.655971:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271896.656042:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788271896.656049:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.656057:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788271896.656064:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271896.656068:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.656078:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.656086:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.656092:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271896.656111:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788271896.656286:0:15106:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:2.0:1788271896.656328:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271896.656333:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.656340:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fca00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:2.0:1788271896.656344:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.656351:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.656361:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.656367:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abf825cd/0xbeb05ca97b5f8565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271896.656380:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.656381:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271896.656383:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271896.659802:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14443:x1875138586967040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 84696us (84783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271896.659816:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271896.659918:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7b3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875138586967040:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788271896.659934:0:14443:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788271896.659984:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875138586967168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788271896.660021:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271896.660075:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6aa09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271896.660494:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967168 00000100:00100000:0.0:1788271896.660502:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967168 00000100:00100000:0.0:1788271896.660553:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271896.660562:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14443:x1875138586967168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788271896.660612:0:15105:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788271896.672488:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14443:x1875138586967168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11918us (12457us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788271896.672504:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271896.672572:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875138586967168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788271896.672596:0:14443:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:0.0:1788271896.691039:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788271897.266579:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788271897.609551:0:16181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788271898.290819:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271899.323623:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271899.615491:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271899.615613:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574392704 00000100:00100000:3.0:1788271899.615623:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574392704 00000100:00100000:3.0:1788271899.615671:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:3.0:1788271899.615680:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f752b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1875138574392704:12345-192.168.201.1@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788271899.615709:0:14412:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e@192.168.201.1@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1788271899.615739:0:14412:0:(genops.c:1385:class_connect()) connect: client ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e, cookie 0xbeb05ca97b5f856c 00000100:00080000:3.0:1788271899.615883:0:14412:0:(import.c:65:import_set_state_nolock()) ffff8ab6e5827800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271899.615963:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f752b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+5:2350:x1875138574392704:12345-192.168.201.1@tcp:250:mount.lustre.0 Request processed in 282us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271899.615972:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:3.0:1788271899.622502:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.622653:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574392832 00000100:00100000:2.0:1788271899.622664:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574392832 00000100:00100000:2.0:1788271899.622717:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:2.0:1788271899.622737:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+5:13776:x1875138574392832:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788271899.622754:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271899.622787:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024a800/0xbeb05ca97b5f8573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023c26 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271899.622817:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024a800/0xbeb05ca97b5f8573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c26 expref: 6 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271899.622828:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024a800/0xbeb05ca97b5f8573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c26 expref: 6 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271899.622838:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a800, rc 0) 00000100:00100000:2.0:1788271899.622900:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+6:13776:x1875138574392832:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 174us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.622907:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:0.0:1788271899.631827:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.632004:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574392960 00000100:00100000:2.0:1788271899.632022:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574392960 00000100:00100000:2.0:1788271899.632081:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:2.0:1788271899.632092:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+6:13776:x1875138574392960:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788271899.632461:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+6:13776:x1875138574392960:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 368us (647us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271899.632470:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:1.0:1788271899.645470:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271899.645746:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393088 00000100:00100000:3.0:1788271899.645757:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393088 00000100:00100000:3.0:1788271899.645816:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:3.0:1788271899.645828:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+6:13776:x1875138574393088:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788271899.645855:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271899.645874:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee18200/0xbeb05ca97b5f857a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023c2d expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271899.645904:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee18200/0xbeb05ca97b5f857a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c2d expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271899.645916:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee18200/0xbeb05ca97b5f857a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c2d expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271899.645926:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18200, rc 0) 00000100:00100000:3.0:1788271899.645987:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+7:13776:x1875138574393088:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 161us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271899.646001:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:3.0:1788271899.654114:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271899.654229:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393216 00000100:00100000:0.0:1788271899.654240:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393216 00000100:00100000:0.0:1788271899.654297:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:0.0:1788271899.654306:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+7:13776:x1875138574393216:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788271899.654645:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13776:x1875138574393216:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 338us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271899.654654:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:0.0:1788271899.657844:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.657991:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393344 00000100:00100000:2.0:1788271899.658002:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393344 00000100:00100000:2.0:1788271899.658055:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:2.0:1788271899.658066:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13776:x1875138574393344:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788271899.658309:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13776:x1875138574393344:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 244us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.658317:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:1.0:1788271899.664527:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271899.665205:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393472 00000100:00100000:3.0:1788271899.665222:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393472 00000100:00100000:3.0:1788271899.668531:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:3.0:1788271899.668566:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13795:x1875138574393472:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271899.669101:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13795:x1875138574393472:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 550us (4592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271899.669112:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:3.0:1788271899.697877:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271899.698238:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393600 00000100:00100000:0.0:1788271899.698249:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393600 00000100:00100000:0.0:1788271899.698308:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:0.0:1788271899.698318:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13795:x1875138574393600:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271899.698631:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13795:x1875138574393600:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 314us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271899.698640:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:0.0:1788271899.702707:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271899.702845:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393728 00000100:00100000:3.0:1788271899.702855:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393728 00000100:00100000:3.0:1788271899.702910:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:3.0:1788271899.702921:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+8:13776:x1875138574393728:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788271899.702938:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271899.702958:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f8581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023c57 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271899.702986:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f8581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c57 expref: 9 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271899.702997:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19200/0xbeb05ca97b5f8581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c57 expref: 9 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271899.703006:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19200, rc 0) 00000100:00100000:3.0:1788271899.703072:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+9:13776:x1875138574393728:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 152us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271899.703094:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:2.0:1788271899.706281:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271899.706370:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393856 00000100:00100000:1.0:1788271899.706380:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393856 00000100:00100000:1.0:1788271899.706467:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:1.0:1788271899.706477:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+9:13776:x1875138574393856:12345-192.168.201.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788271899.706502:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788271899.706539:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788271899.706543:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788271899.706546:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788271899.706549:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788271899.719338:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+9:13776:x1875138574393856:12345-192.168.201.1@tcp:256:mount.lustre.0 Request processed in 12850us (13054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.719354:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:0.0:1788271899.724364:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.724555:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574393984 00000100:00100000:2.0:1788271899.724566:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574393984 00000100:00100000:2.0:1788271899.724630:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:2.0:1788271899.724641:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+9:13776:x1875138574393984:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788271899.724659:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271899.724679:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023c5e expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271899.724709:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271899.724720:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271899.724901:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a600, rc 0) 00000100:00100000:2.0:1788271899.725016:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13776:x1875138574393984:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 375us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.725023:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:1.0:1788271899.743232:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.743381:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574394112 00000100:00100000:2.0:1788271899.743405:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574394112 00000100:00100000:2.0:1788271899.743491:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:2.0:1788271899.743502:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13776:x1875138574394112:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788271899.743822:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13776:x1875138574394112:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 321us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.743838:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:1.0:1788271899.747338:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.747960:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574394240 00000100:00100000:2.0:1788271899.747971:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574394240 00000100:00100000:2.0:1788271899.748065:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:2.0:1788271899.748077:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13776:x1875138574394240:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788271899.748354:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13776:x1875138574394240:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 279us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.748363:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:0.0:1788271899.753372:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271899.754364:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574394368 00000100:00100000:1.0:1788271899.754376:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574394368 00000100:00100000:2.0:1788271899.755090:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:2.0:1788271899.755271:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c6a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13800:x1875138574394368:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788271899.755595:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c6a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13800:x1875138574394368:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 329us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.766681:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:1.0:1788271899.766988:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271899.776825:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574394496 00000100:00100000:0.0:1788271899.776841:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574394496 00000100:00100000:0.0:1788271899.776917:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:0.0:1788271899.776928:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13800:x1875138574394496:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271899.777233:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13800:x1875138574394496:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 306us (10245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271899.777242:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:0.0:1788271899.784246:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.784528:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574394624 00000100:00100000:2.0:1788271899.784538:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574394624 00000100:00100000:2.0:1788271899.784588:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:2.0:1788271899.784597:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1875138574394624:12345-192.168.201.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788271899.784628:0:14419:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6fdae9dd-1719-4c58-a499-19ec5d9d843b@192.168.201.1@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1788271899.784676:0:14419:0:(genops.c:1385:class_connect()) connect: client 6fdae9dd-1719-4c58-a499-19ec5d9d843b, cookie 0xbeb05ca97b5f858f 00000004:00100000:2.0:1788271899.784708:0:14419:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1788271899.784715:0:14419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788271899.832725:0:14419:0:(import.c:65:import_set_state_nolock()) ffff8ab6fe9f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271899.832895:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2350:x1875138574394624:12345-192.168.201.1@tcp:38:mount.lustre.0 Request processed in 48295us (48656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.832925:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1788271899.837017:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271899.837155:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271899.837776:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574394752 00000100:00100000:2.0:1788271899.837788:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574394752 00000100:00080000:3.0:1788271899.837880:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271899.837926:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574394880 00000100:00100000:0.0:1788271899.837931:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574394880 00000100:00100000:0.0:1788271899.837973:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:0.0:1788271899.837984:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:0:x1875138574394752:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788271899.838032:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788271899.838168:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:0:x1875138574394752:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 185us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271899.838186:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:0.0:1788271899.838211:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:0.0:1788271899.838217:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13776:x1875138574394880:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788271899.838229:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788271899.838252:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13776:x1875138574394880:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 35us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271899.838258:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:1.0:1788271899.840827:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271899.841062:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395008 00000100:00100000:0.0:1788271899.841071:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395008 00000100:00100000:0.0:1788271899.841118:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1788271899.841128:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13776:x1875138574395008:12345-192.168.201.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788271899.841312:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13776:x1875138574395008:12345-192.168.201.1@tcp:40:mount.lustre.0 Request processed in 183us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271899.841341:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:3.0:1788271899.844568:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271899.844629:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271899.844692:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271899.844750:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395392 00000100:00100000:0.0:1788271899.844759:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395392 00000100:00100000:0.0:1788271899.844802:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:0.0:1788271899.844810:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13776:x1875138574395392:12345-192.168.201.1@tcp:33:mount.lustre.0 00000100:00100000:3.0:1788271899.845147:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271899.845777:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395520 00000100:00100000:1.0:1788271899.845784:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395520 00000100:00100000:1.0:1788271899.845823:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:1.0:1788271899.845832:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:2354:x1875138574395520:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271899.845896:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:2354:x1875138574395520:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 65us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271899.845903:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 91 00000004:00080000:3.0:1788271899.846671:0:14421:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1794us 00000100:00100000:2.0:1788271899.849227:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395136 00000100:00100000:2.0:1788271899.849242:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395136 00000100:00100000:2.0:1788271899.849295:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395264 00000100:00100000:2.0:1788271899.849299:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395264 00000100:00100000:2.0:1788271899.849329:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1788271899.849338:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875138574395136:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788271899.849368:0:15835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6fdae9dd-1719-4c58-a499-19ec5d9d843b@192.168.201.1@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1788271899.849411:0:15835:0:(genops.c:1385:class_connect()) connect: client 6fdae9dd-1719-4c58-a499-19ec5d9d843b, cookie 0xbeb05ca97b5f8596 00002000:00100000:2.0:1788271899.849437:0:15835:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6fdae9dd-1719-4c58-a499-19ec5d9d843b/ffff8ab6ff6e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788271899.849463:0:15835:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:1.0:1788271899.849761:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271899.849769:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875138574395264:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788271899.849787:0:15107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6fdae9dd-1719-4c58-a499-19ec5d9d843b@192.168.201.1@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1788271899.849808:0:15107:0:(genops.c:1385:class_connect()) connect: client 6fdae9dd-1719-4c58-a499-19ec5d9d843b, cookie 0xbeb05ca97b5f859d 00002000:00100000:1.0:1788271899.849822:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6fdae9dd-1719-4c58-a499-19ec5d9d843b/ffff8ab6cbe31800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788271899.849837:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788271899.850001:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788271899.850037:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8ab6cbe37800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271899.850114:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2350:x1875138574395264:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 343us (5419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271899.850122:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00002000:00080000:2.0:1788271899.850808:0:15835:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788271899.850832:0:15835:0:(import.c:65:import_set_state_nolock()) ffff8ab6ff6ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271899.850879:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2350:x1875138574395136:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 1540us (6248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271899.850888:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000004:00200000:0.0:1788271899.862798:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788271899.862993:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13776:x1875138574395392:12345-192.168.201.1@tcp:33:mount.lustre.0 Request processed in 18177us (18595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271899.863005:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1788271900.039733:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271900.039885:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395648 00000100:00100000:2.0:1788271900.039897:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395648 00000100:00100000:2.0:1788271900.039965:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1788271900.039976:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13821:x1875138574395648:12345-192.168.201.1@tcp:101:mkdir.0 00010000:00010000:2.0:1788271900.039997:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271900.040024:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f85a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023c88 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271900.040112:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f85ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271900.040126:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f85ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271900.040143:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f85ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271900.040340:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788271900.040345:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271900.040483:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f85ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271900.040513:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024ae00/0xbeb05ca97b5f85a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c88 expref: 8 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271900.040607:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f85ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c88 expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271900.040616:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271900.040619:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271900.040624:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b400, rc 0) 00000100:00100000:2.0:1788271900.040692:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:13821:x1875138574395648:12345-192.168.201.1@tcp:101:mkdir.0 Request processed in 718us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271900.040699:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1788271900.147116:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586967296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271900.147224:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271900.147388:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967296 00000100:00100000:1.0:1788271900.147397:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967296 00000100:00100000:1.0:1788271900.147492:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271900.147502:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586967296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271900.147526:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788271900.147602:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271900.154192:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586967296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6670us (6946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271900.154208:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788271900.159823:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586967296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788271900.338572:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271901.362792:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271901.684135:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271901.684170:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586967424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271901.684238:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271901.684307:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967424 00000100:00100000:3.0:1788271901.684315:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967424 00000100:00100000:3.0:1788271901.684363:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271901.684372:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586967424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271901.684393:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788271901.684904:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586967680:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.684952:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271901.684974:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788271901.685097:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586967552:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.685128:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271901.685817:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586968064:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.685856:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271901.685889:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968064 00000100:00100000:1.0:1788271901.685895:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968064 00000100:00100000:1.0:1788271901.686069:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788271901.686079:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586968064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271901.686121:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967552 00000100:00100000:1.0:1788271901.686125:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875138586968064:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271901.686126:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967552 00000100:00100000:1.0:1788271901.686131:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271901.686166:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788271901.686173:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3281:x1875138586967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271901.686206:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3281:x1875138586967552:12345-0@lo:400:kworker.0 Request processed in 34us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271901.686212:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788271901.686603:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586967936:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.686637:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271901.686664:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271901.686670:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586967808:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.686694:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271901.686732:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967936 00000100:00100000:1.0:1788271901.686736:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967936 00000100:00100000:1.0:1788271901.686761:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967808 00000100:00100000:1.0:1788271901.686764:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967808 00000100:00100000:1.0:1788271901.686776:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788271901.686782:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586967936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271901.686803:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788271901.686810:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788271901.686815:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875138586967936:12345-0@lo:400:kworker.0 Request processed in 33us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271901.686821:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788271901.686833:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788271901.686839:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586967808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.686864:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875138586967808:12345-0@lo:400:kworker.0 Request processed in 25us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271901.686869:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788271901.686902:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875138586967808:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.686913:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875138586967936:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.687243:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586967552:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.687255:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875138586968064:0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.687275:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586967680 00000100:00100000:1.0:1788271901.687280:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586967680 00000100:00100000:1.0:1788271901.687307:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271901.687313:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586967680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271901.687349:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586967680:12345-0@lo:400:kworker.0 Request processed in 35us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271901.687355:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271901.687381:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586967680:0@lo:400:kworker.0 00000100:00100000:2.0:1788271901.688219:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586967424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3845us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271901.688234:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788271901.688259:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271901.688265:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271901.691337:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586967424:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788271901.872132:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788271901.872263:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fdae9dd-1719-4c58-a499-19ec5d9d843b 00000001:00100000:0.0:1788271901.872269:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788271902.059965:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271902.060128:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395776 00000100:00100000:1.0:1788271902.060149:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395776 00000100:00100000:1.0:1788271902.060283:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271902.060295:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:13873:x1875138574395776:12345-192.168.201.1@tcp:41:lfs.0 00000004:00000024:1.0:1788271902.060342:0:14419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788271902.060466:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:13873:x1875138574395776:12345-192.168.201.1@tcp:41:lfs.0 Request processed in 173us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271902.060484:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00080000:2.0:1788271902.063765:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271902.072321:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.080028:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574395904 00000100:00100000:2.0:1788271902.080044:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574395904 00000100:00100000:2.0:1788271902.080282:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1788271902.080294:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13873:x1875138574395904:12345-192.168.201.1@tcp:13:lfs.0 00002000:00000024:2.0:1788271902.080330:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271902.080441:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:13873:x1875138574395904:12345-192.168.201.1@tcp:13:lfs.0 Request processed in 149us (8129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.080450:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00080000:3.0:1788271902.091023:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271902.091263:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.091471:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396032 00000100:00100000:2.0:1788271902.091493:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396032 00000100:00100000:2.0:1788271902.091606:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1788271902.091617:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:13873:x1875138574396032:12345-192.168.201.1@tcp:13:lfs.0 00002000:00000024:2.0:1788271902.091655:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788271902.091754:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:13873:x1875138574396032:12345-192.168.201.1@tcp:13:lfs.0 Request processed in 131us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.091762:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00080000:3.0:1788271902.092915:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271902.350212:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.350336:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396160 00000100:00100000:2.0:1788271902.350347:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396160 00000100:00100000:2.0:1788271902.350407:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:2.0:1788271902.350442:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+10:13904:x1875138574396160:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788271902.350460:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271902.350479:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024ae00/0xbeb05ca97b5f85b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023c8f expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.350510:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024ae00/0xbeb05ca97b5f85b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c8f expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.350522:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024ae00/0xbeb05ca97b5f85b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c8f expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.350533:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024ae00, rc 0) 00000100:00100000:2.0:1788271902.351330:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13904:x1875138574396160:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 884us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.351341:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:1.0:1788271902.372707:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.372823:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396288 00000100:00100000:2.0:1788271902.372833:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396288 00000100:00100000:2.0:1788271902.372896:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:2.0:1788271902.372921:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13904:x1875138574396288:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788271902.373578:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13904:x1875138574396288:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 657us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.373588:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 94 00010000:00010000:2.0:1788271902.386672:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271902.387379:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271902.388508:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396416 00000100:00100000:3.0:1788271902.388521:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396416 00000100:00100000:3.0:1788271902.389221:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00100000:3.0:1788271902.389234:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13904:x1875138574396416:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788271902.390171:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13904:x1875138574396416:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 936us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271902.390182:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00100000:1.0:1788271902.414497:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271902.414589:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396544 00000100:00100000:0.0:1788271902.414600:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396544 00000100:00100000:0.0:1788271902.414660:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:0.0:1788271902.414672:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13912:x1875138574396544:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271902.415028:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13912:x1875138574396544:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 358us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.415036:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:1.0:1788271902.439541:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271902.439652:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396672 00000100:00100000:3.0:1788271902.439664:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396672 00000100:00100000:3.0:1788271902.439725:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:3.0:1788271902.439736:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13912:x1875138574396672:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271902.440358:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13912:x1875138574396672:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 620us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271902.440368:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:1.0:1788271902.453056:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271902.453263:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396800 00000100:00100000:0.0:1788271902.453274:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396800 00000100:00100000:0.0:1788271902.453327:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:0.0:1788271902.453338:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13904:x1875138574396800:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788271902.453370:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271902.453387:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f85b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023cb9 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271902.453437:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f85b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cb9 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271902.453449:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c13fc000/0xbeb05ca97b5f85b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cb9 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271902.453459:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c13fc000, rc 0) 00000100:00100000:0.0:1788271902.453503:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13904:x1875138574396800:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 167us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.453509:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:1.0:1788271902.461207:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271902.461367:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574396928 00000100:00100000:0.0:1788271902.461379:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574396928 00000100:00100000:0.0:1788271902.461479:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:0.0:1788271902.461489:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13904:x1875138574396928:12345-192.168.201.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788271902.461518:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788271902.461543:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788271902.461547:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788271902.461550:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788271902.461552:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788271902.464050:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13904:x1875138574396928:12345-192.168.201.1@tcp:256:mount.lustre.0 Request processed in 2550us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.464075:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:1.0:1788271902.474556:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.474644:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397056 00000100:00100000:2.0:1788271902.474654:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397056 00000100:00100000:2.0:1788271902.474735:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:2.0:1788271902.474746:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13904:x1875138574397056:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788271902.474764:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271902.474781:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023cc0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.474810:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.474822:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.474832:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b200, rc 0) 00000100:00100000:2.0:1788271902.474896:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13904:x1875138574397056:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 152us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.474903:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:1.0:1788271902.480840:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271902.480944:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397184 00000100:00100000:0.0:1788271902.480955:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397184 00000100:00100000:0.0:1788271902.481027:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:0.0:1788271902.481037:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13904:x1875138574397184:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788271902.481660:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13904:x1875138574397184:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 621us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.481669:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:3.0:1788271902.486324:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271902.489250:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397312 00000100:00100000:0.0:1788271902.489267:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397312 00000100:00100000:0.0:1788271902.489345:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:0.0:1788271902.489357:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13904:x1875138574397312:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788271902.489785:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13904:x1875138574397312:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 428us (3471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.489794:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:1.0:1788271902.495083:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271902.495290:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397440 00000100:00100000:0.0:1788271902.495747:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397440 00000100:00100000:0.0:1788271902.495855:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:0.0:1788271902.495866:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13918:x1875138574397440:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271902.496171:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13918:x1875138574397440:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 305us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.496178:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:1.0:1788271902.500842:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.500952:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397568 00000100:00100000:2.0:1788271902.500963:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397568 00000100:00100000:2.0:1788271902.501023:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:2.0:1788271902.501033:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13918:x1875138574397568:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788271902.501503:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13918:x1875138574397568:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 469us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.501512:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:3.0:1788271902.513800:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.514062:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397696 00000100:00100000:2.0:1788271902.514073:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397696 00000100:00100000:2.0:1788271902.514139:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1788271902.514148:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875138574397696:12345-192.168.201.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788271902.514179:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2c243dd0-b761-4246-9c20-eb0b6359bc38@192.168.201.1@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1788271902.514216:0:14418:0:(genops.c:1385:class_connect()) connect: client 2c243dd0-b761-4246-9c20-eb0b6359bc38, cookie 0xbeb05ca97b5f85c7 00000004:00100000:2.0:1788271902.514246:0:14418:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788271902.514386:0:14418:0:(import.c:65:import_set_state_nolock()) ffff8ab6ffc26800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271902.514499:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2350:x1875138574397696:12345-192.168.201.1@tcp:38:mount.lustre.0 Request processed in 350us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.514507:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1788271902.521650:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271902.521695:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271902.521832:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397952 00000100:00100000:3.0:1788271902.521843:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397952 00000100:00100000:3.0:1788271902.521918:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574397824 00000100:00100000:3.0:1788271902.521921:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574397824 00000100:00100000:3.0:1788271902.521949:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:3.0:1788271902.521959:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+7:13904:x1875138574397952:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788271902.521992:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788271902.522063:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+7:13904:x1875138574397952:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 103us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271902.522071:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:3.0:1788271902.522091:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:3.0:1788271902.522098:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:0:x1875138574397824:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788271902.522136:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788271902.522161:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:0:x1875138574397824:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 63us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271902.522168:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00080000:0.0:1788271902.522353:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271902.528195:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271902.528272:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398080 00000100:00100000:3.0:1788271902.528292:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398080 00000100:00100000:3.0:1788271902.528353:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271902.528365:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:13904:x1875138574398080:12345-192.168.201.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788271902.528488:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:13904:x1875138574398080:12345-192.168.201.1@tcp:40:mount.lustre.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271902.528495:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271902.533685:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271902.533727:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271902.533758:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271902.533916:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398208 00000100:00100000:0.0:1788271902.533926:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398208 00000100:00100000:0.0:1788271902.533968:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398336 00000100:00100000:0.0:1788271902.533971:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398336 00000100:00100000:0.0:1788271902.533991:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1788271902.533999:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875138574398208:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788271902.534046:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2c243dd0-b761-4246-9c20-eb0b6359bc38@192.168.201.1@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:0.0:1788271902.534075:0:15106:0:(genops.c:1385:class_connect()) connect: client 2c243dd0-b761-4246-9c20-eb0b6359bc38, cookie 0xbeb05ca97b5f85ce 00002000:00100000:0.0:1788271902.534086:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2c243dd0-b761-4246-9c20-eb0b6359bc38/ffff8ab6f7359800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271902.534098:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788271902.534241:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788271902.534270:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8ab6f735e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271902.534346:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2350:x1875138574398208:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 345us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.534354:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1788271902.534371:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1788271902.534375:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875138574398336:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788271902.534390:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2c243dd0-b761-4246-9c20-eb0b6359bc38@192.168.201.1@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:0.0:1788271902.534404:0:15106:0:(genops.c:1385:class_connect()) connect: client 2c243dd0-b761-4246-9c20-eb0b6359bc38, cookie 0xbeb05ca97b5f85d5 00002000:00100000:0.0:1788271902.534410:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2c243dd0-b761-4246-9c20-eb0b6359bc38/ffff8ab6f735b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271902.534448:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788271902.534640:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788271902.534657:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8ab6f735d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271902.534681:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2350:x1875138574398336:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 304us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271902.534688:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1788271902.534969:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398464 00000100:00100000:1.0:1788271902.534975:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398464 00000100:00100000:1.0:1788271902.535016:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:1.0:1788271902.535024:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:13904:x1875138574398464:12345-192.168.201.1@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788271902.535274:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788271902.535397:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:13904:x1875138574398464:12345-192.168.201.1@tcp:33:mount.lustre.0 Request processed in 373us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271902.535406:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:1.0:1788271902.712697:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271902.713536:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398592 00000100:00100000:2.0:1788271902.713547:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398592 00000100:00100000:2.0:1788271902.713607:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:2.0:1788271902.713617:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:13939:x1875138574398592:12345-192.168.201.1@tcp:101:mkdir.0 00010000:00010000:2.0:1788271902.713635:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271902.713655:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f85dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023cea expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.713722:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.713735:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.713879:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271902.714139:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788271902.714144:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271902.714224:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.714253:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f85dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 8 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.714272:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271902.714280:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271902.714283:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271902.714286:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024bc00, rc 0) 00000100:00100000:2.0:1788271902.714409:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+7:13939:x1875138574398592:12345-192.168.201.1@tcp:101:mkdir.0 Request processed in 793us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271902.714472:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000001:00100000:2.0:1788271903.336651:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c243dd0-b761-4246-9c20-eb0b6359bc38 00000001:00100000:2.0:1788271903.336670:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6fdae9dd-1719-4c58-a499-19ec5d9d843b 00010000:00010000:1.0:1788271903.410802:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271904.434610:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271905.269010:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271905.270104:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586968192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271905.270179:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271905.270461:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968192 00000100:00100000:3.0:1788271905.270470:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968192 00000100:00080000:2.0:1788271905.271120:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271905.271733:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271905.271748:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586968192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271905.271790:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271905.271864:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586968192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271905.272544:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271905.272613:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586968192:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788271905.379401:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2c243dd0-b761-4246-9c20-eb0b6359bc38 00000001:00100000:1.0:1788271905.380537:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6fdae9dd-1719-4c58-a499-19ec5d9d843b 00000001:02000400:2.0:1788271905.449904:0:16386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788271905.459801:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271906.488281:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271906.814393:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586968576:0@lo:400:kworker.0 00000100:00100000:3.0:1788271906.814501:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271906.814561:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586968320:0@lo:400:kworker.0 00000100:00100000:3.0:1788271906.814576:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271906.814586:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586968704:0@lo:400:kworker.0 00000100:00100000:1.0:1788271906.814603:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271906.814634:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586968832:0@lo:400:kworker.0 00000100:00100000:3.0:1788271906.814639:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271906.814687:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968704 00000100:00100000:3.0:1788271906.814695:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968704 00000100:00100000:3.0:1788271906.814747:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271906.814758:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586968704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271906.814779:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271906.814804:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788271906.814817:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586968448:0@lo:400:kworker.0 00000100:00100000:3.0:1788271906.814826:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586968704:12345-0@lo:400:kworker.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271906.814835:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788271906.814846:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271906.814854:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968832 00000100:00100000:3.0:1788271906.814859:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968832 00000100:00100000:1.0:1788271906.814869:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586968960:0@lo:400:kworker.0 00000100:00100000:3.0:1788271906.814898:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271906.814906:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586968832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271906.814937:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875138586968832:12345-0@lo:400:kworker.0 Request processed in 33us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271906.814943:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788271906.814960:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271906.814960:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271906.815001:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875138586968832:0@lo:400:kworker.0 00000100:00100000:1.0:1788271906.815188:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271906.815204:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586969088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271906.815239:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271906.817189:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968960 00000100:00100000:1.0:1788271906.817203:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968960 00000100:00100000:3.0:1788271906.817266:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586968704:0@lo:400:kworker.0 00000100:00100000:1.0:1788271906.817266:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271906.817279:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586968960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788271906.817298:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271906.817362:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586968960:12345-0@lo:400:kworker.0 Request processed in 87us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271906.817369:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271906.817395:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586969088 00000100:00100000:1.0:1788271906.817399:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586969088 00000100:00100000:1.0:1788271906.817461:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271906.817469:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586969088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271906.817495:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586968960:0@lo:400:kworker.0 00002000:00000024:1.0:1788271906.817496:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788271906.817523:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271906.817547:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586969088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271906.817554:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271906.817562:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788271906.817581:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586969088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271906.820402:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968320 00000100:00100000:1.0:1788271906.820434:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968320 00000100:00100000:1.0:1788271906.820489:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788271906.820499:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3278:x1875138586968320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271906.820590:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3278:x1875138586968320:12345-0@lo:400:kworker.0 Request processed in 93us (5989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271906.820597:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788271906.820633:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968576 00000100:00100000:1.0:1788271906.820650:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968576 00000100:00100000:3.0:1788271906.821135:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586968320:0@lo:400:kworker.0 00000100:00100000:2.0:1788271906.822572:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586968448 00000100:00100000:2.0:1788271906.822583:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586968448 00000100:00100000:2.0:1788271906.822628:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271906.822647:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586968576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271906.822730:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586968576:12345-0@lo:400:kworker.0 Request processed in 87us (8242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271906.822738:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271906.822758:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271906.822766:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586968448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271906.822806:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875138586968448:12345-0@lo:400:kworker.0 Request processed in 41us (7960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271906.822813:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271906.824741:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586968448:0@lo:400:kworker.0 00000100:00100000:3.0:1788271906.825190:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586968576:0@lo:400:kworker.0 00000001:00100000:2.0:1788271906.858857:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2c243dd0-b761-4246-9c20-eb0b6359bc38 00000040:00080000:2.0:1788271906.939253:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788271907.506518:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271907.955617:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271907.955660:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271907.955742:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271907.955785:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398848 00000100:00100000:3.0:1788271907.955794:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398848 00000100:00100000:3.0:1788271907.955888:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1788271907.955900:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2352:x1875138574398848:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271907.955980:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2352:x1875138574398848:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 74us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271907.955987:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00080000:0.0:1788271907.956590:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271907.959231:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271907.959266:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271907.959305:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398720 00000100:00100000:0.0:1788271907.959314:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398720 00000100:00100000:0.0:1788271907.959375:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:0.0:1788271907.959394:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2352:x1875138574398720:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271907.959487:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2352:x1875138574398720:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271907.959494:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:1.0:1788271907.959671:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574399104 00000100:00100000:1.0:1788271907.959676:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574399104 00000100:00100000:0.0:1788271907.963051:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574399360 00000100:00100000:0.0:1788271907.963066:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574399360 00000100:00100000:0.0:1788271907.963106:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:0.0:1788271907.963117:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2352:x1875138574399104:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271907.963200:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2352:x1875138574399104:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 84us (7539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271907.963207:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:0.0:1788271907.963225:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:0.0:1788271907.963232:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574399360:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271907.963256:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574399360:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (7514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271907.963262:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00080000:1.0:1788271907.965159:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271907.965168:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271907.971244:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271907.971293:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271907.977527:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574399232 00000100:00100000:2.0:1788271907.977544:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574399232 00000100:00100000:2.0:1788271907.977625:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:2.0:1788271907.977636:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2352:x1875138574399232:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271907.977714:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2352:x1875138574399232:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 80us (6479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271907.977722:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00080000:2.0:1788271907.977757:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271907.981653:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574398976 00000100:00100000:1.0:1788271907.981666:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574398976 00000100:00100000:1.0:1788271907.981744:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574399488 00000100:00100000:1.0:1788271907.981747:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574399488 00000100:00100000:1.0:1788271907.981784:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1788271907.981796:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2352:x1875138574398976:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271907.981913:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:0.0:1788271907.981923:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574399488:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271907.982277:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2352:x1875138574398976:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 481us (23008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271907.982284:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1788271907.982467:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574399488:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 544us (11172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271907.982541:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00080000:0.0:1788271907.982560:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271907.982565:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788271908.530743:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788271909.229881:0:16534:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd89a2b6d0 20000000:00000080:1.0:1788271909.229914:0:16534:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab6ea6ee000 uarg=0000000000000000 20000000:01000000:1.0:1788271909.229954:0:16534:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788271909.229960:0:16534:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788271909.229966:0:16534:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788271909.234215:0:16535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788271909.239684:0:16534:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788271909.246177:0:16534:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788271909.246212:0:16534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246233:0:16534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246257:0:16534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246264:0:16534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246274:0:16534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246281:0:16534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246288:0:16534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246334:0:16534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.246351:0:16534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 12 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271909.246979:0:16534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6eda29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969216:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271909.247491:0:16534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.247505:0:16534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 12 pid: 14410 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271909.247516:0:16534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969344:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271909.247547:0:16534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.247555:0:16534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 18 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271909.247565:0:16534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969472:0@lo:104: 00000100:00100000:0.0:1788271909.247604:0:16534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271909.247637:0:16534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.247646:0:16534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 18 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271909.247647:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586969472 00000100:00100000:1.0:1788271909.247656:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586969472 00000100:00100000:0.0:1788271909.247660:0:16534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969600:0@lo:104: 00000100:00100000:0.0:1788271909.247684:0:16534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271909.247704:0:16534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.247712:0:16534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 18 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271909.247737:0:16534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969728:0@lo:104: 00000100:00100000:0.0:1788271909.247762:0:16534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271909.247772:0:16534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c551ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271909.247846:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788271909.247858:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586969600 00000100:00100000:3.0:1788271909.247862:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586969600 00000100:00100000:3.0:1788271909.247894:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586969728 00000100:00100000:3.0:1788271909.247897:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586969728 00000100:00100000:3.0:1788271909.248246:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271909.248258:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+5:16534:x1875138586969600:12345-0@lo:104: 00010000:00010000:3.0:1788271909.248272:0:14401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.248333:0:14401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271909.248339:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+5:16534:x1875138586969600:12345-0@lo:104: Request processed in 84us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271909.248404:0:16534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969600:0@lo:104: 00010000:00010000:0.0:1788271909.252588:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271909.252602:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.252614:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18400 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:0.0:1788271909.252620:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.252639:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271909.252646:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271909.252651:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271909.252705:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.252711:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271909.252748:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.252755:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6dee18400/0xbeb05ca97b5f8327 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f832e expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.252781:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271909.252783:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271909.252785:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271909.252929:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586969856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271909.252995:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271909.253154:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586969856 00000100:00100000:2.0:1788271909.253162:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586969856 00010000:00010000:2.0:1788271909.253198:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 19 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271909.253235:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271909.253244:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b79826ef-d055-4784-972d-a5e369371347+19:3281:x1875138586969856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271909.253256:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271909.253260:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 19 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271909.253270:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 19 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271909.253283:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024a200/0xbeb05ca97b5f832e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f8327 expref: 19 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271909.253297:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271909.253343:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b79826ef-d055-4784-972d-a5e369371347+18:3281:x1875138586969856:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271909.253349:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271909.253442:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586969856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271909.254056:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271909.254085:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271909.254095:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7536850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+4:16534:x1875138586969728:12345-0@lo:104: 00010000:00010000:3.0:1788271909.254107:0:14401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254189:0:14401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271909.254195:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7536850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+4:16534:x1875138586969728:12345-0@lo:104: Request processed in 104us (6432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271909.254202:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271909.254216:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271909.254222:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+3:16534:x1875138586969472:12345-0@lo:104: 00010000:00010000:3.0:1788271909.254230:0:14401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254263:0:14401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788271909.254269:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b79826ef-d055-4784-972d-a5e369371347+3:16534:x1875138586969472:12345-0@lo:104: Request processed in 47us (6666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271909.254275:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788271909.254315:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271909.254320:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254329:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7c00 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271909.254333:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254342:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271909.254351:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271909.254357:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788271909.254392:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254399:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271909.254448:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254455:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6edee7c00/0xbeb05ca97b5f82da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f82e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254467:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271909.254470:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254475:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6000 already unused, calling callback (ffffffffc1a08c20) 10000000:00010000:3.0:1788271909.254478:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254484:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271909.254490:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271909.254495:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788271909.254508:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254513:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271909.254519:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254536:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6000/0xbeb05ca97b5f845b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbeb05ca97b5f8462 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254547:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271909.254549:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271909.254550:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271909.254563:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586969984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271909.254596:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271909.254625:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271909.254645:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586970112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271909.254667:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271909.254692:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586969984 00000100:00100000:3.0:1788271909.254696:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586969984 00010000:00010000:3.0:1788271909.254713:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 18 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271909.254731:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586970112 00000100:00100000:3.0:1788271909.254733:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586970112 00010000:00010000:3.0:1788271909.254742:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 19 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271909.254752:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271909.254758:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+19:3278:x1875138586969984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271909.254765:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271909.254769:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 19 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254778:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 19 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254797:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271909.254824:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+19:3278:x1875138586969984:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271909.254831:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271909.254845:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271909.254850:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7431050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+18:3278:x1875138586970112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271909.254856:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271909.254860:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 18 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254866:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 18 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.254875:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271909.254892:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7431050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b79826ef-d055-4784-972d-a5e369371347+18:3278:x1875138586970112:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271909.254910:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271909.255023:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586970112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271909.255036:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b79826ef-d055-4784-972d-a5e369371347:3278:1875138586969984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271909.255815:0:16534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6ea2d7600/0xbeb05ca97b5f8462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f845b expref: 17 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271909.255830:0:16534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969472:0@lo:104: 00010000:00010000:0.0:1788271909.255840:0:16534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6ff374a00/0xbeb05ca97b5f82e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbeb05ca97b5f82da expref: 16 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271909.255847:0:16534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969728:0@lo:104: 00010000:00010000:1.0:1788271909.256071:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271909.256309:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271909.256344:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271909.256458:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574399616 00000100:00100000:1.0:1788271909.256465:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574399616 00010000:00010000:1.0:1788271909.256491:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 13 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271909.256508:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574399744 00000100:00100000:1.0:1788271909.256511:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574399744 00010000:00010000:1.0:1788271909.256523:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 14 pid: 14410 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271909.256537:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1788271909.256545:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+14:2354:x1875138574399616:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271909.256556:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271909.256561:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 14 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256571:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 14 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256586:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271909.256641:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+14:2354:x1875138574399616:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271909.256649:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1788271909.256666:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:1.0:1788271909.256673:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2354:x1875138574399744:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271909.256680:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271909.256684:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 13 pid: 14410 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256704:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 13 pid: 14410 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256727:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256735:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256750:0:14404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256757:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256763:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256769:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256776:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7e00 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271909.256780:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256787:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256796:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271909.256815:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271909.256835:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2354:x1875138574399744:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 163us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271909.256841:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00010000:00010000:0.0:1788271909.257857:0:16534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024b200/0xbeb05ca97b5f85c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cc0 expref: 12 pid: 14412 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271909.257873:0:16534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6eda29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969216:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271909.257886:0:16534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab70024a600/0xbeb05ca97b5f8588 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023c5e expref: 11 pid: 14410 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271909.258053:0:16534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16534:1875138586969344:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271909.258086:0:16534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.258097:0:16534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.258102:0:16534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271909.258123:0:16534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab6edee7e00/0xbeb05ca97b5f85ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271909.554729:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271910.389753:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271910.389788:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586970240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271910.389858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271910.391507:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586970240 00000100:00100000:3.0:1788271910.391519:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586970240 00000100:00100000:3.0:1788271910.391655:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271910.391665:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586970240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271910.391700:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271910.391767:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875138586970240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1908us total) trans 0 rc 0/0 00000100:00080000:2.0:1788271910.391848:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271910.391885:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271910.391934:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875138586970240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271910.510671:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271910.513041:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574399872 00000100:00100000:0.0:1788271910.513055:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574399872 00000100:00100000:0.0:1788271910.513188:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:0.0:1788271910.513199:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+11:13790:x1875138574399872:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271910.513219:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271910.513240:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6c13fd600/0xbeb05ca97b5f85f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023cf1 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271910.513267:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6c13fd600/0xbeb05ca97b5f85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cf1 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271910.513277:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6c13fd600/0xbeb05ca97b5f85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cf1 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271910.513287:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c13fd600, rc 0) 00000100:00100000:0.0:1788271910.513354:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13790:x1875138574399872:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 156us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271910.513361:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:1.0:1788271910.533877:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271910.533949:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400000 00000100:00100000:3.0:1788271910.533960:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400000 00000100:00100000:3.0:1788271910.534031:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 108 00000100:00100000:3.0:1788271910.534043:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13790:x1875138574400000:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271910.534365:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13790:x1875138574400000:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 322us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271910.534374:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 108 00000100:00100000:0.0:1788271910.537240:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271910.537325:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400128 00000100:00100000:3.0:1788271910.537335:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400128 00000100:00100000:3.0:1788271910.537386:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:3.0:1788271910.537395:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13790:x1875138574400128:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271910.537614:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13790:x1875138574400128:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 219us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271910.537623:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:1.0:1788271910.555898:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271910.556189:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400256 00000100:00100000:3.0:1788271910.556202:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400256 00000100:00100000:3.0:1788271910.556264:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00100000:3.0:1788271910.556276:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+12:13790:x1875138574400256:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271910.556294:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271910.556312:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19800/0xbeb05ca97b5f85f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x769326461023cf8 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271910.556367:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19800/0xbeb05ca97b5f85f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cf8 expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271910.556379:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19800/0xbeb05ca97b5f85f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cf8 expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271910.556389:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19800, rc 0) 00000100:00100000:3.0:1788271910.556629:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13790:x1875138574400256:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 353us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271910.556637:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00100000:1.0:1788271910.564010:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271910.564215:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400384 00000100:00100000:3.0:1788271910.564225:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400384 00000100:00100000:3.0:1788271910.564283:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 111 00000100:00100000:3.0:1788271910.564294:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13790:x1875138574400384:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271910.564625:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13790:x1875138574400384:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 330us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271910.564634:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 111 00010000:00010000:1.0:1788271910.580752:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271910.586747:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271910.586832:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400512 00000100:00100000:3.0:1788271910.586842:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400512 00000100:00100000:3.0:1788271910.586892:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:3.0:1788271910.586903:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13790:x1875138574400512:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271910.587154:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:13790:x1875138574400512:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 252us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271910.587163:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 112 10000000:01000000:3.0:1788271911.026527:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788271911.026553:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c8228800 from 10 10000000:01000000:3.0:1788271911.026559:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271911.026609:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f85ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271911.026621:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f85ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271911.026633:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f85ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271911.026660:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6edc9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271911.026731:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271911.026799:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6eea44cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271911.026934:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586970368 00000100:00100000:2.0:1788271911.026943:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586970368 00000100:00100000:2.0:1788271911.027009:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788271911.027020:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+16:14416:x1875138586970368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271911.027040:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271911.027053:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab70024b000/0xbeb05ca97b5f8606 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f85ff expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.027076:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab70024b000/0xbeb05ca97b5f8606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f85ff expref: 17 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.027086:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab70024b000/0xbeb05ca97b5f8606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f85ff expref: 17 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.027095:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b000, rc 0) 00000100:00100000:2.0:1788271911.027150:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+17:14416:x1875138586970368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271911.027157:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788271911.027260:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6edc9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271911.027276:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f85ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8606 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271911.027284:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f85ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8606 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271911.027364:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271911.027392:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271911.027463:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ccc383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271911.027519:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586970496 00000100:00100000:1.0:1788271911.027524:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586970496 00000100:00100000:1.0:1788271911.027557:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788271911.027565:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+17:14416:x1875138586970496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.027823:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+17:14416:x1875138586970496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271911.027831:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788271911.028015:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.028049:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.028088:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271911.028103:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c1254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271911.028114:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586970624 00000100:00100000:1.0:1788271911.028118:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586970624 00000100:00100000:1.0:1788271911.028135:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788271911.028147:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+17:14416:x1875138586970624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.028282:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+17:14416:x1875138586970624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271911.028289:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788271911.028325:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788271911.028998:0:16603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788271911.029051:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788271911.029066:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271911.029074:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f85ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8606 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271911.029083:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6dee19000/0xbeb05ca97b5f85ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8606 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271911.029092:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271911.029095:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6c3077000 from 10 10000000:01000000:1.0:1788271911.029097:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271911.029122:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6c00/0xbeb05ca97b5f860d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271911.029130:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6c00/0xbeb05ca97b5f860d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271911.029139:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6c00/0xbeb05ca97b5f860d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271911.029156:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.029193:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271911.029230:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c1254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271911.029246:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586970752 00000100:00100000:1.0:1788271911.029250:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586970752 00000100:00100000:1.0:1788271911.029272:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788271911.029280:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6fe9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+17:14416:x1875138586970752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271911.029290:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271911.029302:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6edee6e00/0xbeb05ca97b5f8614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f860d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271911.029319:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6edee6e00/0xbeb05ca97b5f8614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f860d expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271911.029329:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6edee6e00/0xbeb05ca97b5f8614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f860d expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271911.029337:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6e00, rc 0) 00000100:00100000:1.0:1788271911.029367:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6fe9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:14416:x1875138586970752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271911.029374:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788271911.029405:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271911.029441:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6c00/0xbeb05ca97b5f860d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8614 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271911.029450:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6c00/0xbeb05ca97b5f860d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8614 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271911.029489:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.029514:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271911.029539:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c1254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271911.029549:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586970880 00000100:00100000:1.0:1788271911.029552:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586970880 00000100:00100000:1.0:1788271911.029569:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788271911.029574:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:14416:x1875138586970880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.029748:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:14416:x1875138586970880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271911.029754:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788271911.029779:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586970880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.029802:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.029838:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271911.029852:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c1254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271911.029862:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971008 00000100:00100000:1.0:1788271911.029865:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971008 00000100:00100000:1.0:1788271911.029880:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788271911.029886:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:14416:x1875138586971008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271911.030017:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:14416:x1875138586971008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271911.030024:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788271911.030056:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788271911.048196:0:16604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788271911.048794:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788271911.048818:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271911.048829:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6c00/0xbeb05ca97b5f860d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8614 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.048841:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab6edee6c00/0xbeb05ca97b5f860d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8614 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271911.048852:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788271911.048854:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab6f73f3800 from 10 10000000:01000000:2.0:1788271911.048856:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271911.048898:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024b200/0xbeb05ca97b5f861b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.048907:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff8ab70024b200/0xbeb05ca97b5f861b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.048934:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff8ab70024b200/0xbeb05ca97b5f861b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271911.048960:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271911.049040:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271911.049101:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6aa0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271911.053595:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971136 00000100:00100000:3.0:1788271911.053606:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971136 00000100:00100000:3.0:1788271911.053672:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788271911.053682:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+18:14416:x1875138586971136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271911.053699:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271911.053717:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab6dee19c00/0xbeb05ca97b5f8622 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbeb05ca97b5f861b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271911.053744:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab6dee19c00/0xbeb05ca97b5f8622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbeb05ca97b5f861b expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271911.053755:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab6dee19c00/0xbeb05ca97b5f8622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbeb05ca97b5f861b expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271911.053765:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19c00, rc 0) 00000100:00100000:3.0:1788271911.053845:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586971136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (4803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271911.053853:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788271911.054029:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271911.054048:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff8ab70024b200/0xbeb05ca97b5f861b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8622 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.054057:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff8ab70024b200/0xbeb05ca97b5f861b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbeb05ca97b5f8622 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271911.054125:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271911.054163:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271911.054199:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6aa0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271911.054258:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971264 00000100:00100000:3.0:1788271911.054262:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971264 00000100:00100000:3.0:1788271911.054550:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788271911.054561:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586971264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271911.054802:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586971264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271911.054810:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788271911.054890:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271911.054922:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271911.054963:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271911.055001:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6aa0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271911.055014:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971392 00000100:00100000:2.0:1788271911.055018:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971392 00000100:00100000:2.0:1788271911.055041:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788271911.055048:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586971392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271911.055191:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:14416:x1875138586971392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271911.055205:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788271911.055242:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b79826ef-d055-4784-972d-a5e369371347:14416:1875138586971392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788271911.057755:0:16606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788271911.058378:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788271911.058521:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271911.058532:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff8ab70024b200/0xbeb05ca97b5f861b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8622 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271911.058545:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff8ab70024b200/0xbeb05ca97b5f861b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbeb05ca97b5f8622 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271911.604369:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271911.922801:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271911.922824:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586971520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271911.922950:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271911.923126:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971520 00000100:00100000:3.0:1788271911.923135:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971520 00000100:00100000:3.0:1788271911.923199:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271911.923212:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586971520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271911.923261:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271911.923327:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586971520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271911.923335:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788271911.923363:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271911.923400:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586971520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271911.925288:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586972032:0@lo:400:kworker.0 00000100:00100000:1.0:1788271911.925407:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586971776:0@lo:400:kworker.0 00000100:00100000:1.0:1788271911.925529:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271911.925566:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788271911.925572:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b79826ef-d055-4784-972d-a5e369371347:3279:1875138586971648:0@lo:400:kworker.0 00000100:00100000:1.0:1788271911.925601:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271911.925644:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586972160:0@lo:400:kworker.0 00000100:00100000:1.0:1788271911.925670:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271911.925701:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586972160 00000100:00100000:1.0:1788271911.925708:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586972160 00000100:00100000:1.0:1788271911.925762:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788271911.925772:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586972160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271911.925823:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875138586972160:12345-0@lo:400:kworker.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271911.925830:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788271911.925852:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271911.925878:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875138586972160:0@lo:400:kworker.0 00000100:00100000:0.0:1788271911.926006:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271911.926025:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271911.926032:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586971904:0@lo:400:kworker.0 00000100:00100000:0.0:1788271911.926090:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271911.926159:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971776 00000100:00100000:2.0:1788271911.926164:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971776 00000100:00100000:2.0:1788271911.926214:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271911.926220:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586971776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271911.926250:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586971776:12345-0@lo:400:kworker.0 Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271911.926254:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271911.926270:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971648 00000100:00100000:2.0:1788271911.926272:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971648 00000100:00100000:2.0:1788271911.926287:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788271911.926291:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3279:x1875138586971648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271911.926320:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b79826ef-d055-4784-972d-a5e369371347+19:3279:x1875138586971648:12345-0@lo:400:kworker.0 Request processed in 28us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271911.926333:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788271911.926761:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586972032 00000100:00100000:3.0:1788271911.926765:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586972032 00000100:00100000:3.0:1788271911.926795:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586971904 00000100:00100000:3.0:1788271911.926797:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586971904 00000100:00100000:3.0:1788271911.926806:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788271911.926811:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586972032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271911.926848:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586972032:12345-0@lo:400:kworker.0 Request processed in 37us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271911.926852:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788271911.926863:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271911.926869:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586971904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271911.926893:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875138586971904:12345-0@lo:400:kworker.0 Request processed in 25us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271911.926899:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271911.927236:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b79826ef-d055-4784-972d-a5e369371347:3279:1875138586971648:0@lo:400:kworker.0 00000100:00100000:1.0:1788271911.927269:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586971776:0@lo:400:kworker.0 00000100:00080000:2.0:1788271911.927683:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271911.927768:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875138586971904:0@lo:400:kworker.0 00000100:00100000:0.0:1788271911.927775:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586972032:0@lo:400:kworker.0 00010000:00010000:1.0:1788271912.626872:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271913.074928:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.075025:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.077659:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400768 00000100:00100000:2.0:1788271913.077676:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400768 00000100:00100000:2.0:1788271913.077819:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:2.0:1788271913.077833:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2352:x1875138574400768:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271913.077926:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2352:x1875138574400768:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 98us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.077934:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00080000:1.0:1788271913.079003:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271913.084516:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400640 00000100:00100000:3.0:1788271913.084530:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400640 00000100:00100000:3.0:1788271913.084597:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:3.0:1788271913.084608:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2352:x1875138574400640:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271913.089862:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2352:x1875138574400640:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 5242us (14931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271913.089877:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:1.0:1788271913.092034:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.092177:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.092218:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.092247:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.092267:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.092307:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574401152 00000100:00100000:1.0:1788271913.092316:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574401152 00000100:00100000:1.0:1788271913.092380:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:2.0:1788271913.092806:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574401024 00000100:00100000:2.0:1788271913.092812:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574401024 00000100:00100000:2.0:1788271913.092837:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574401280 00000100:00100000:2.0:1788271913.092840:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574401280 00000100:00100000:2.0:1788271913.092850:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574400896 00000100:00100000:2.0:1788271913.092852:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574400896 00000100:00100000:2.0:1788271913.092864:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574401408 00000100:00100000:2.0:1788271913.092866:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574401408 00000100:00100000:2.0:1788271913.092880:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1788271913.092888:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2351:x1875138574401024:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271913.092974:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2351:x1875138574401024:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 87us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.092982:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1788271913.093003:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1788271913.093010:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2351:x1875138574401280:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271913.093064:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2351:x1875138574401280:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 54us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.093100:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1788271913.093114:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1788271913.093121:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2351:x1875138574400896:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271913.093147:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2351:x1875138574400896:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.093154:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1788271913.093165:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:2.0:1788271913.093172:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2351:x1875138574401408:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271913.093193:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2351:x1875138574401408:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 22us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.093200:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00080000:2.0:1788271913.093363:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271913.093368:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271913.093371:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271913.093822:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2351:x1875138574401152:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271913.094265:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2351:x1875138574401152:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 1874us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271913.094275:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:1.0:1788271913.131991:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.132893:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574401536 00000100:00100000:2.0:1788271913.132904:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574401536 00000100:00100000:2.0:1788271913.132979:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:2.0:1788271913.132990:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:14450:x1875138574401536:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271913.133012:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.133033:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023cff expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.133102:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.133118:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.133146:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.133163:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.133170:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.133177:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.134232:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f863e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.134247:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f863e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.134257:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f863e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271913.134344:0:16297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788271913.134348:0:16297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271913.136734:0:16297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f863e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.136757:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.136765:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137184:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137190:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.137195:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137202:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137219:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271913.137223:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.137228:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137234:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137249:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137255:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137260:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137265:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.137268:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137283:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137291:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ab6c4f64a00) 00010000:00010000:2.0:1788271913.137293:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.137296:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137302:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137352:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cff expref: 8 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137367:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b800/0xbeb05ca97b5f863e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cff expref: 7 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.137375:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab6c4f64400) 00010000:00010000:2.0:1788271913.137377:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271913.137380:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b800, rc 0) 00000100:00100000:2.0:1788271913.138780:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:14450:x1875138574401536:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 5783us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.138792:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1788271913.151140:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.151224:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574401792 00000100:00100000:2.0:1788271913.151235:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574401792 00000100:00100000:2.0:1788271913.151306:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:2.0:1788271913.151318:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:14450:x1875138574401792:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271913.151357:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.151380:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8645 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d06 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.151624:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.151646:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.151659:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.151710:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.151718:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.151853:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.154132:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f865a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.154153:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f865a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.154164:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f865a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271913.154178:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788271913.156661:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156679:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156686:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156693:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.156698:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156706:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156735:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab6c4f64400) 00010000:00010000:2.0:1788271913.156739:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.156744:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156751:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f864c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156767:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156773:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156779:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156802:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.156805:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156812:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156821:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab6c4f64a00) 00010000:00010000:2.0:1788271913.156824:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.156827:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.156834:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f8653 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.157301:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8645 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d06 expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.157318:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b600/0xbeb05ca97b5f865a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d06 expref: 9 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.157326:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c4f64300) 00010000:00010000:2.0:1788271913.157329:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.157331:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024b600, rc 0) 00000100:00100000:2.0:1788271913.157452:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14450:x1875138574401792:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 6099us (6284us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788271913.157461:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1788271913.175111:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271913.175275:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574401920 00000100:00100000:0.0:1788271913.175285:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574401920 00000100:00100000:0.0:1788271913.175362:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1788271913.175374:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14450:x1875138574401920:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788271913.175528:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14450:x1875138574401920:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 Request processed in 155us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271913.175536:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1788271913.220717:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.220818:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574402048 00000100:00100000:2.0:1788271913.220839:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574402048 00000100:00100000:2.0:1788271913.220903:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1788271913.220913:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14456:x1875138574402048:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271913.220932:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.220963:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d0d expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221037:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221051:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221064:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221090:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221098:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221105:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221378:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221386:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221392:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221404:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.221408:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221460:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221473:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271913.221476:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.221481:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221664:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f866f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221682:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221688:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221694:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221698:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.221701:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221707:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221726:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab6c4f64a00) 00010000:00010000:2.0:1788271913.221729:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.221732:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221737:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8676 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221771:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8668 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d0d expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221781:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:2.0:1788271913.221784:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.221787:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d0d expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.221799:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024be00, rc 0) 00000100:00100000:2.0:1788271913.221868:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14456:x1875138574402048:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 956us (1161us total) trans 0 rc 301/301 00000100:00100000:2.0:1788271913.221875:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1788271913.226588:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.226687:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574402176 00000100:00100000:2.0:1788271913.226697:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574402176 00000100:00100000:2.0:1788271913.226753:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:2.0:1788271913.226763:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14456:x1875138574402176:12345-192.168.201.1@tcp:700:lfs.0 00000100:00100000:2.0:1788271913.226850:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14456:x1875138574402176:12345-192.168.201.1@tcp:700:lfs.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.226858:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1788271913.229354:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.229526:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574402432 00000100:00100000:1.0:1788271913.229540:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574402432 00000100:00100000:1.0:1788271913.229617:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1788271913.229632:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14456:x1875138574402432:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:1.0:1788271913.229725:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271913.229775:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f85ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023c88 expref: 9 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.229804:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:1.0:1788271913.229810:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271913.230370:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.230390:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 5 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.230460:0:14420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.230515:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 5 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.230547:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 5 pid: 14418 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271913.230566:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3260700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14420:1875138586972288:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271913.230698:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c5022180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271913.234095:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3260700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14420:1875138586972288:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271913.234140:0:14420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271913.234667:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.235561:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574402560 00000100:00100000:1.0:1788271913.235572:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574402560 00010000:00010000:1.0:1788271913.235629:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 6 pid: 14418 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271913.235675:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:1.0:1788271913.235686:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2353:x1875138574402560:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271913.235704:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271913.235711:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 6 pid: 14418 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.235725:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 6 pid: 14418 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.235752:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f85e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023cea expref: 6 pid: 14418 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.235785:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:1.0:1788271913.235791:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.235822:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.235830:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.235863:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271913.235954:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2353:x1875138574402560:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 269us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271913.235962:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00010000:00010000:0.0:1788271913.236391:0:14420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.236447:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.236482:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.236494:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.236504:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271913.243938:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788271913.243972:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.243985:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.243994:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.244000:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271913.244005:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.244011:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.244030:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6c4f64700) 00010000:00010000:0.0:1788271913.244034:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271913.244047:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.244068:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f867d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271913.244094:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4be2e7d reply state 0000000094ee67d1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271913.244105:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271913.244495:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14456:x1875138574402432:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 14862us (15151us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788271913.244506:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00010000:00010000:2.0:1788271913.249657:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.249680:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.249689:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.249697:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.249702:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.249709:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.249728:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab6d96b4b00) 00010000:00010000:2.0:1788271913.249732:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.249746:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.249753:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8684 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271913.347952:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.348232:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574402688 00000100:00100000:1.0:1788271913.348245:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574402688 00000100:00100000:1.0:1788271913.348323:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:1.0:1788271913.348335:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:14464:x1875138574402688:12345-192.168.201.1@tcp:101:lctl.0 00010000:00010000:1.0:1788271913.348369:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271913.348458:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f868b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d14 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.348548:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7200/0xbeb05ca97b5f8692 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.348566:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7200/0xbeb05ca97b5f8692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.348579:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7200/0xbeb05ca97b5f8692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271913.348658:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788271913.348663:0:14419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271913.348745:0:14419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7200/0xbeb05ca97b5f8692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.348775:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f868b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d14 expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.348798:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7200/0xbeb05ca97b5f8692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d14 expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.348807:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:1.0:1788271913.348810:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271913.348814:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7200, rc 0) 00000100:00100000:1.0:1788271913.348897:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14464:x1875138574402688:12345-192.168.201.1@tcp:101:lctl.0 Request processed in 563us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271913.348904:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1788271913.373547:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.373683:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574402816 00000100:00100000:2.0:1788271913.373703:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574402816 00000100:00100000:2.0:1788271913.373787:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:2.0:1788271913.373800:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:14465:x1875138574402816:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271913.373833:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.373859:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8699 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d1b expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.373985:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f86a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.374001:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.374014:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271913.374095:0:16297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788271913.374098:0:16297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271913.374147:0:16297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.374175:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8699 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d1b expref: 7 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.374198:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a200/0xbeb05ca97b5f86a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d1b expref: 6 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.374208:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:2.0:1788271913.374210:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271913.374215:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a200, rc 0) 00000100:00100000:2.0:1788271913.374294:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:14465:x1875138574402816:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 498us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.374301:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:3.0:1788271913.379071:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.379871:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574402944 00000100:00100000:1.0:1788271913.379885:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574402944 00000100:00100000:1.0:1788271913.380028:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:1.0:1788271913.380041:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:14465:x1875138574402944:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271913.380070:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271913.380099:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f86a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d22 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.380188:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.380207:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.380218:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.380253:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.380261:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.380267:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.382869:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f86bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.382895:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f86bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.382909:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f86bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271913.382990:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788271913.382995:0:14419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271913.383021:0:14419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f86bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383228:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383235:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383241:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383263:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271913.383267:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383274:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383288:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:1.0:1788271913.383291:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271913.383296:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383301:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f86ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383317:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383322:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383329:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383334:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271913.383337:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383343:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383360:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab6cb419100) 00010000:00010000:1.0:1788271913.383362:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271913.383365:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383370:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383410:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f86a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d22 expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383522:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f86bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d22 expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.383530:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271913.383533:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271913.383535:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6000, rc 0) 00000100:00100000:1.0:1788271913.383621:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+7:14465:x1875138574402944:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 3581us (4563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271913.383629:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:3.0:1788271913.388578:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.388934:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574403200 00000100:00100000:2.0:1788271913.388955:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574403200 00000100:00100000:2.0:1788271913.389034:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:2.0:1788271913.389044:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c243dd0-b761-4246-9c20-eb0b6359bc38+7:14465:x1875138574403200:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271913.389063:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.389094:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f86c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d29 expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271913.389216:0:16297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788271913.389336:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f86c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d29 expref: 9 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.389350:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:2.0:1788271913.389353:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271913.389359:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f86c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d29 expref: 9 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.389373:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a600, rc 0) 00000100:00100000:2.0:1788271913.389459:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c243dd0-b761-4246-9c20-eb0b6359bc38+8:14465:x1875138574403200:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 417us (892us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788271913.389466:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:3.0:1788271913.394137:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.394222:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574403456 00000100:00100000:2.0:1788271913.394233:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574403456 00000100:00100000:2.0:1788271913.394302:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:2.0:1788271913.394313:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+8:14465:x1875138574403456:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:2.0:1788271913.394367:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271913.394798:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f86bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d22 expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.394839:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:2.0:1788271913.394849:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271913.394878:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.394890:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.394900:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271913.395128:0:14418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d66f04b9 reply state 00000000e56c4de8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271913.395138:0:14418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788271913.395151:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788271913.395295:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+9:14465:x1875138574403456:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 982us (1166us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788271913.395303:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00010000:00010000:0.0:1788271913.401889:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.401908:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.401915:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.401921:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024bc00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271913.401925:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.401932:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.401960:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6c4f64a00) 00010000:00010000:0.0:1788271913.401963:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788271913.401968:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.401987:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f86d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271913.403529:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271913.403596:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574403712 00000100:00100000:0.0:1788271913.403606:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574403712 00000100:00100000:0.0:1788271913.403664:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:0.0:1788271913.403675:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+8:14465:x1875138574403712:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271913.403935:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+9:14465:x1875138574403712:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 260us (413us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788271913.403954:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:1.0:1788271913.409520:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.409758:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574403968 00000100:00100000:2.0:1788271913.409769:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574403968 00000100:00100000:2.0:1788271913.409818:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:2.0:1788271913.409827:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c243dd0-b761-4246-9c20-eb0b6359bc38+9:14465:x1875138574403968:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1788271913.409849:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.409870:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f86d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d30 expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.409953:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.409978:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.409990:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410006:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410013:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410020:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271913.410151:0:16297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788271913.410238:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410247:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410253:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410259:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.410264:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410272:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410694:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:2.0:1788271913.410697:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.410701:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410707:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f86df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410719:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410725:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410730:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410736:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024b400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.410739:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410745:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410753:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab6c4f64000) 00010000:00010000:2.0:1788271913.410756:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.410759:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410765:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f86e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410817:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f86d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d30 expref: 11 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410828:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:2.0:1788271913.410831:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271913.410834:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f86d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d30 expref: 11 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.410846:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a600, rc 0) 00000100:00100000:2.0:1788271913.410914:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c243dd0-b761-4246-9c20-eb0b6359bc38+10:14465:x1875138574403968:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1087us (1402us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788271913.410924:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:3.0:1788271913.418815:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.418914:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574404096 00000100:00100000:1.0:1788271913.418925:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574404096 00000100:00100000:1.0:1788271913.418998:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:1.0:1788271913.419009:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+10:14465:x1875138574404096:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271913.419035:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271913.419059:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f86f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d37 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.419794:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.419810:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.420402:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271913.420678:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788271913.420682:0:14419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271913.420706:0:14419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.420740:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f86f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.420761:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.420770:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:1.0:1788271913.420773:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271913.420776:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7400, rc 0) 00000100:00100000:1.0:1788271913.420853:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+11:14465:x1875138574404096:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1845us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271913.420861:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:3.0:1788271913.429213:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271913.433460:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574404224 00000100:00100000:0.0:1788271913.433476:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574404224 00000100:00100000:0.0:1788271913.433564:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:0.0:1788271913.433574:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+11:14465:x1875138574404224:12345-192.168.201.1@tcp:37:lfs.0 00000100:00100000:0.0:1788271913.438338:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+11:14465:x1875138574404224:12345-192.168.201.1@tcp:37:lfs.0 Request processed in 4753us (9122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271913.438353:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1788271913.444072:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.444174:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574404480 00000100:00100000:2.0:1788271913.444184:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574404480 00000100:00100000:2.0:1788271913.444234:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:2.0:1788271913.444243:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab701cc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+11:14465:x1875138574404480:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271913.444521:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab701cc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c243dd0-b761-4246-9c20-eb0b6359bc38+12:14465:x1875138574404480:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 277us (457us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788271913.444530:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1788271913.504513:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271913.504874:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574404608 00000100:00100000:0.0:1788271913.504885:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574404608 00000100:00100000:0.0:1788271913.504976:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:0.0:1788271913.504987:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14471:x1875138574404608:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1788271913.505008:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271913.505030:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f8702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d3e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505098:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505125:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505136:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505151:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505158:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505165:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505274:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc200/0xbeb05ca97b5f8717 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505408:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc200/0xbeb05ca97b5f8717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.505455:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc200/0xbeb05ca97b5f8717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271913.505824:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788271913.505829:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271913.505875:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc200/0xbeb05ca97b5f8717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505887:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505893:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505899:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505907:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fca00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271913.505910:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505917:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505933:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:3.0:1788271913.505946:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271913.505952:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505957:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fca00/0xbeb05ca97b5f8709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505974:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505991:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.505997:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.506001:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c13fd400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271913.506004:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.506010:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.506018:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab6d96b4100) 00010000:00010000:3.0:1788271913.506020:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271913.506023:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.506029:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd400/0xbeb05ca97b5f8710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.506061:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fd000/0xbeb05ca97b5f8702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d3e expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.506073:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c13fc200/0xbeb05ca97b5f8717 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d3e expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.506080:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:3.0:1788271913.506082:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788271913.506091:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c13fc200, rc 0) 00000100:00100000:3.0:1788271913.506164:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+11:14471:x1875138574404608:12345-192.168.201.1@tcp:101:bash.0 Request processed in 1177us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271913.506171:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1788271913.513694:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.513798:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574404864 00000100:00100000:2.0:1788271913.513808:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574404864 00000100:00100000:2.0:1788271913.513866:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:2.0:1788271913.513876:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+11:14471:x1875138574404864:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271913.513896:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.513918:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f871e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d45 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.514067:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.514082:0:14418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.514091:0:14418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.514129:0:14418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.514141:0:14418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 11 pid: 14419 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271913.514155:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14418:1875138586972416:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271913.514247:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6aa06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271913.519688:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.519800:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14418:1875138586972416:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271913.519830:0:14418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271913.520046:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574404992 00000100:00100000:3.0:1788271913.520054:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574404992 00010000:00010000:3.0:1788271913.520090:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 12 pid: 14419 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271913.520129:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:3.0:1788271913.520139:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+12:2354:x1875138574404992:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271913.520153:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271913.520161:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 12 pid: 14419 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.520173:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 12 pid: 14419 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.520195:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7400/0xbeb05ca97b5f86fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d37 expref: 12 pid: 14419 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.520214:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:3.0:1788271913.520219:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.520228:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.520247:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271913.520276:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271913.520351:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c243dd0-b761-4246-9c20-eb0b6359bc38+11:2354:x1875138574404992:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 214us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271913.520359:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00010000:00010000:2.0:1788271913.521450:0:14418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.521462:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.521533:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.521544:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.521562:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.522928:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.522953:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.522964:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271913.522979:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788271913.523015:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523023:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523030:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523036:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271913.523041:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523049:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523061:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:2.0:1788271913.523065:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271913.523078:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523084:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8725 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271913.523098:0:14418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017481a59 reply state 0000000058b2db1c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271913.523108:0:14418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788271913.523148:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f871e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523163:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 13 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.523171:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271913.523174:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788271913.523177:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024bc00, rc 0) 00000100:00100000:2.0:1788271913.523301:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+14:14471:x1875138574404864:12345-192.168.201.1@tcp:101:bash.0 Request processed in 9424us (9615us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788271913.523310:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00010000:00010000:0.0:1788271913.529049:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.529066:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.529073:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.529096:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271913.529102:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.529109:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.529124:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab6c4f64000) 00010000:00010000:0.0:1788271913.529127:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271913.529132:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271913.529139:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f872c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271913.535074:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.535146:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574405120 00000100:00100000:2.0:1788271913.535158:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574405120 00000100:00100000:2.0:1788271913.535222:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1788271913.535233:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14471:x1875138574405120:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1788271913.535257:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271913.535574:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f8741 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d4c expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.535662:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8748 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.535677:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.535689:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271913.535728:0:16297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788271913.535733:0:16297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271913.535752:0:16297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.535764:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.535788:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f8741 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d4c expref: 15 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.535806:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8748 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d4c expref: 14 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271913.535815:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271913.535818:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271913.535822:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024be00, rc 0) 00000100:00100000:2.0:1788271913.535929:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+14:14471:x1875138574405120:12345-192.168.201.1@tcp:101:bash.0 Request processed in 697us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271913.535948:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1788271913.539645:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.539753:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574405376 00000100:00100000:1.0:1788271913.539763:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574405376 00000100:00100000:1.0:1788271913.539822:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:1.0:1788271913.539832:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+14:14471:x1875138574405376:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:1.0:1788271913.540218:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+15:14471:x1875138574405376:12345-192.168.201.1@tcp:35:bash.0 Request processed in 384us (579us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788271913.540226:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:3.0:1788271913.632699:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.632800:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574405632 00000100:00100000:1.0:1788271913.632811:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574405632 00000100:00100000:1.0:1788271913.632877:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:1.0:1788271913.632889:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+15:14481:x1875138574405632:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271913.632913:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271913.632942:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f874f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d53 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271913.633065:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788271913.633187:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f874f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d53 expref: 17 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.633203:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:1.0:1788271913.633206:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271913.633211:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f874f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d53 expref: 17 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.633226:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7c00, rc 0) 00000100:00100000:1.0:1788271913.633368:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+16:14481:x1875138574405632:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 480us (679us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788271913.633389:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:3.0:1788271913.636541:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.636749:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574405888 00000100:00100000:2.0:1788271913.636760:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574405888 00000100:00100000:2.0:1788271913.636811:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1788271913.636818:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+16:14481:x1875138574405888:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271913.637080:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14481:x1875138574405888:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 257us (543us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788271913.637093:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00010000:00010000:3.0:1788271913.657172:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271913.698212:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.698615:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574406144 00000100:00100000:1.0:1788271913.698626:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574406144 00000100:00100000:1.0:1788271913.698755:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:1.0:1788271913.698768:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14484:x1875138574406144:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271913.698794:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271913.698820:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f875d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d5a expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.698917:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8764 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.698928:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.698951:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271913.698963:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788271913.699100:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f875d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d5a expref: 20 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.699121:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8764 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d5a expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.699130:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271913.699133:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271913.699136:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6200, rc 0) 00000100:00100000:1.0:1788271913.699216:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:14484:x1875138574406144:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 451us (1014us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788271913.699224:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:3.0:1788271913.702461:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.702610:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574406400 00000100:00100000:1.0:1788271913.702620:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574406400 00000100:00100000:1.0:1788271913.702689:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:1.0:1788271913.702701:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:14484:x1875138574406400:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:1.0:1788271913.702794:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702813:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702826:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702855:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702867:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702874:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702880:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7e00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271913.702885:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702893:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702925:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271913.702929:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271913.702944:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.702951:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8772 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271913.703032:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:14484:x1875138574406400:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 333us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271913.703039:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:3.0:1788271913.706223:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271913.706353:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574406272 00000100:00100000:1.0:1788271913.706362:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574406272 00000100:00100000:1.0:1788271913.706459:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1788271913.706470:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:2354:x1875138574406272:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271913.706496:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271913.706520:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8764 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d5a expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271913.706539:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271913.706544:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271913.706591:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+18:2354:x1875138574406272:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 123us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271913.706597:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1788271913.708070:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271913.708617:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574406656 00000100:00100000:2.0:1788271913.708626:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574406656 00000100:00100000:2.0:1788271913.708680:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:2.0:1788271913.708690:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+18:14484:x1875138574406656:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1788271913.708920:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:14484:x1875138574406656:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 229us (857us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788271913.708927:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000040:00080000:2.0:1788271914.099172:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788271914.182541:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271914.182671:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574406912 00000100:00100000:2.0:1788271914.182681:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574406912 00000100:00100000:2.0:1788271914.182742:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1788271914.182752:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:14515:x1875138574406912:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:2.0:1788271914.182778:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271914.182797:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f8779 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d61 expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.182882:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8780 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.182910:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.182920:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271914.182942:0:16297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788271914.183179:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f8779 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d61 expref: 22 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.183204:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8780 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d61 expref: 21 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.183213:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271914.183215:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271914.183218:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a600, rc 0) 00000100:00100000:2.0:1788271914.183681:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+21:14515:x1875138574406912:12345-192.168.201.1@tcp:101:cat.0 Request processed in 926us (1147us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788271914.183689:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:3.0:1788271914.189410:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271914.189542:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271914.189707:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574407296 00000100:00100000:1.0:1788271914.189717:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574407296 00000100:00100000:1.0:1788271914.189794:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:1.0:1788271914.189818:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+21:2354:x1875138574407296:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271914.189837:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271914.189865:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8780 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d61 expref: 21 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.189886:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271914.189892:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271914.189973:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+20:2354:x1875138574407296:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 156us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271914.189980:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:2.0:1788271914.190798:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574407168 00000100:00100000:2.0:1788271914.190806:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574407168 00000100:00100000:2.0:1788271914.190847:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1788271914.190857:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+20:14515:x1875138574407168:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:2.0:1788271914.191276:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+21:14515:x1875138574407168:12345-192.168.201.1@tcp:35:cat.0 Request processed in 419us (1875us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788271914.191285:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:3.0:1788271914.305568:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271914.308160:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574407552 00000100:00100000:2.0:1788271914.308192:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574407552 00000100:00100000:2.0:1788271914.308397:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:2.0:1788271914.308411:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+21:14521:x1875138574407552:12345-192.168.201.1@tcp:101:dd.0 00010000:00010000:2.0:1788271914.308452:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271914.308474:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f878e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d68 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.308575:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8795 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.308588:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.308599:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271914.308609:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788271914.308816:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f878e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d68 expref: 24 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.308837:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8795 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d68 expref: 23 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.308845:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271914.308848:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271914.308851:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab70024a600, rc 0) 00000100:00100000:2.0:1788271914.309944:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+23:14521:x1875138574407552:12345-192.168.201.1@tcp:101:dd.0 Request processed in 1528us (4379us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788271914.327809:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:0.0:1788271914.328002:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271914.328084:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574407808 00000100:00100000:1.0:1788271914.328093:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574407808 00000100:00100000:1.0:1788271914.328137:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:1.0:1788271914.328145:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+23:14521:x1875138574407808:12345-192.168.201.1@tcp:36:dd.0 00010000:00010000:1.0:1788271914.328198:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788271914.328222:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f8795 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d68 expref: 23 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.328243:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f8748 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d4c expref: 22 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.328253:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271914.328261:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271914.328497:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.328510:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.328528:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271914.328581:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788271914.328615:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb9f8ffb reply state 00000000f39ad143 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271914.328622:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271914.328707:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+24:14521:x1875138574407808:12345-192.168.201.1@tcp:36:dd.0 Request processed in 562us (706us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788271914.328712:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000020:00080000:1.0:1788271914.328714:0:14420:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788271914.333373:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271914.333391:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271914.333399:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271914.333407:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271914.333437:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271914.333461:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271914.333480:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:3.0:1788271914.333483:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271914.333488:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271914.333495:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271914.471865:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271914.471970:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574408064 00000100:00100000:2.0:1788271914.471980:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574408064 00000100:00100000:2.0:1788271914.472035:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1788271914.472047:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+23:14521:x1875138574408064:12345-192.168.201.1@tcp:35:dd.0 00000100:00100000:2.0:1788271914.472304:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+24:14521:x1875138574408064:12345-192.168.201.1@tcp:35:dd.0 Request processed in 259us (450us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788271914.472312:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00010000:00010000:1.0:1788271914.676458:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271914.741657:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271914.741753:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574408192 00000100:00100000:1.0:1788271914.741763:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574408192 00000100:00100000:1.0:1788271914.741832:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:1.0:1788271914.741843:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+24:14535:x1875138574408192:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:1.0:1788271914.741867:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271914.741887:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d6f expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.741965:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.741978:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.741988:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742023:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742030:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742037:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742131:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742139:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742161:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271914.742195:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788271914.742199:0:14419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271914.742235:0:14419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742248:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742256:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742263:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742279:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742285:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271914.742289:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742296:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742309:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:1.0:1788271914.742312:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271914.742316:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742323:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f87b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742337:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742343:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742349:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742353:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271914.742566:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742582:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742591:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271914.742593:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271914.742596:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742601:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742631:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d6f expref: 26 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742644:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d6f expref: 25 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.742650:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271914.742652:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271914.742654:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6800, rc 0) 00000100:00100000:1.0:1788271914.742711:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+25:14535:x1875138574408192:12345-192.168.201.1@tcp:101:stat.0 Request processed in 870us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271914.742718:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:3.0:1788271914.829770:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271914.829966:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574408448 00000100:00100000:1.0:1788271914.829975:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574408448 00000100:00100000:1.0:1788271914.830035:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1788271914.830044:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+25:14541:x1875138574408448:12345-192.168.201.1@tcp:36:truncate.0 00010000:00010000:1.0:1788271914.830123:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271914.830152:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d6f expref: 25 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.830173:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271914.830177:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271914.830403:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.830469:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271914.830480:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271914.830537:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1788271914.830562:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aafcff69 reply state 00000000480aee74 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271914.830578:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271914.830687:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+27:14541:x1875138574408448:12345-192.168.201.1@tcp:36:truncate.0 Request processed in 643us (926us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788271914.830697:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00000020:00080000:1.0:1788271914.830701:0:14420:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271914.837002:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.837022:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.837031:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.837037:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271914.837042:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.837049:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.837066:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271914.837069:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271914.837074:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271914.837080:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7600/0xbeb05ca97b5f87c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271915.050740:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271915.051029:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574408576 00000100:00100000:2.0:1788271915.051040:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574408576 00000100:00100000:2.0:1788271915.051179:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:2.0:1788271915.051190:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+26:14555:x1875138574408576:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:2.0:1788271915.051213:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271915.051233:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f87cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d76 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051327:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051343:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051355:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051370:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051377:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051384:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051786:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051796:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051813:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271915.051848:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788271915.051852:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271915.051874:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051887:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051895:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051902:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051922:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051929:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024be00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271915.051933:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051942:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051954:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:2.0:1788271915.051957:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271915.051961:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051978:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024be00/0xbeb05ca97b5f87d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.051993:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052000:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052006:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052012:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab70024a600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271915.052015:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052022:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052029:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab6c4f64800) 00010000:00010000:2.0:1788271915.052032:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271915.052035:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052042:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024a600/0xbeb05ca97b5f87db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052073:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024b400/0xbeb05ca97b5f87cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 28 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052099:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 27 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.052107:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271915.052110:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271915.052112:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148ba00, rc 0) 00000100:00100000:2.0:1788271915.052225:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+27:14555:x1875138574408576:12345-192.168.201.1@tcp:101:stat.0 Request processed in 1036us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271915.052234:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00080000:1.0:1788271915.053072:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271915.161252:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271915.161405:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574408832 00000100:00100000:1.0:1788271915.161452:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574408832 00000100:00100000:1.0:1788271915.161527:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1788271915.161537:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+27:14565:x1875138574408832:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1788271915.161576:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271915.161597:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d7d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271915.161711:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788271915.161824:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d7d expref: 29 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.161839:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:1.0:1788271915.161843:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271915.161849:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d7d expref: 29 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.161862:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee6800, rc 0) 00000100:00100000:1.0:1788271915.162030:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+28:14565:x1875138574408832:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 494us (786us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1788271915.162038:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:0.0:1788271915.165541:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271915.165664:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574409088 00000100:00100000:3.0:1788271915.165674:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574409088 00000100:00100000:3.0:1788271915.165729:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:3.0:1788271915.165739:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab701cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+28:14565:x1875138574409088:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1788271915.166000:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab701cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+29:14565:x1875138574409088:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 261us (468us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788271915.166007:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:3.0:1788271915.236548:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271915.236693:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574409344 00000100:00100000:1.0:1788271915.236703:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574409344 00000100:00100000:1.0:1788271915.236760:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:1.0:1788271915.236770:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+29:14571:x1875138574409344:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271915.236793:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271915.236813:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d84 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.236947:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.236972:0:14419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 30 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.236979:0:14419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 30 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.236986:0:14419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.237017:0:14419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 30 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.237029:0:14419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 30 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271915.237042:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3260000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586972544:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271915.237142:0:14419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 30 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.237151:0:14419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 30 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271915.237158:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3263100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586972672:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271915.237178:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ede38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271915.244812:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271915.244866:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271915.244961:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574409472 00000100:00100000:2.0:1788271915.244970:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574409472 00010000:00010000:2.0:1788271915.245011:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 31 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271915.245053:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574409600 00000100:00100000:2.0:1788271915.245056:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574409600 00010000:00010000:2.0:1788271915.245074:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 32 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271915.245090:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1788271915.245098:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7433450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+32:2354:x1875138574409472:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271915.245113:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271915.245121:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 32 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245133:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 32 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245166:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271915.245171:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245179:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245184:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271915.245235:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7433450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+32:2354:x1875138574409472:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271915.245242:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1788271915.245297:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1788271915.245304:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+31:2354:x1875138574409600:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271915.245312:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271915.245317:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 31 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245326:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 31 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245337:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271915.245340:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245348:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245363:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.245379:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271915.245410:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+31:2354:x1875138574409600:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 105us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271915.245465:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00010000:00010000:1.0:1788271915.246138:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ba00/0xbeb05ca97b5f87e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d76 expref: 30 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271915.246169:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3260000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586972544:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271915.246185:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab70024bc00/0xbeb05ca97b5f8733 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d45 expref: 29 pid: 14418 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271915.246193:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3263100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586972672:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271915.246213:0:14419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.246221:0:14419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.246227:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271915.246247:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788271915.246583:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f87f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 30 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.246599:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 29 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.246607:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271915.246609:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788271915.246612:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7800, rc 0) 00000100:00100000:1.0:1788271915.246748:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+29:14571:x1875138574409344:12345-192.168.201.1@tcp:101:bash.0 Request processed in 9979us (10209us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788271915.246766:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:0.0:1788271915.251030:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271915.251099:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574409856 00000100:00100000:1.0:1788271915.251109:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574409856 00000100:00100000:1.0:1788271915.251165:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:1.0:1788271915.251175:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+29:14571:x1875138574409856:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:1.0:1788271915.251486:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.251502:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.251513:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271915.251587:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1788271915.251612:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff36cbb9 reply state 000000004693cd24 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271915.251621:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271915.251711:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+32:14571:x1875138574409856:12345-192.168.201.1@tcp:36:bash.0 Request processed in 536us (690us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788271915.251718:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00000020:00080000:1.0:1788271915.251723:0:14420:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788271915.254404:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271915.254469:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271915.254494:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271915.254500:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271915.254505:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271915.254513:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271915.254530:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:0.0:1788271915.254533:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271915.254537:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271915.254544:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6600/0xbeb05ca97b5f880c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271915.254771:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271915.255015:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574409984 00000100:00100000:3.0:1788271915.255026:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574409984 00000100:00100000:3.0:1788271915.255085:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:3.0:1788271915.255095:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+31:14571:x1875138574409984:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271915.255117:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271915.255134:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8813 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d8b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.255198:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8813 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d8b expref: 32 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.255211:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8813 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d8b expref: 32 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.255228:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:3.0:1788271915.255231:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271915.255234:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19a00, rc 0) 00000100:00100000:3.0:1788271915.255307:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+32:14571:x1875138574409984:12345-192.168.201.1@tcp:101:bash.0 Request processed in 213us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271915.255313:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:3.0:1788271915.263077:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271915.263166:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574410112 00000100:00100000:1.0:1788271915.263176:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574410112 00000100:00100000:1.0:1788271915.263234:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:1.0:1788271915.263244:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+32:14571:x1875138574410112:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1788271915.263293:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271915.263313:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f881a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d92 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.263396:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.263410:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 33 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.263466:0:14420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.263501:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 33 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.263514:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 33 pid: 14419 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271915.263528:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3260000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14420:1875138586972800:192.168.201.1@tcp:104: 00000100:00100000:1.0:1788271915.263609:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ede38300 going to sleep for 11 seconds 00000100:00100000:1.0:1788271915.266042:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3260000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14420:1875138586972800:192.168.201.1@tcp:104: 00010000:00010000:1.0:1788271915.266069:0:14420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271915.267575:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271915.267713:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574410240 00000100:00100000:2.0:1788271915.267723:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574410240 00010000:00010000:2.0:1788271915.267761:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 34 pid: 14419 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271915.267804:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:2.0:1788271915.267814:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+34:2354:x1875138574410240:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271915.267828:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271915.267835:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 34 pid: 14419 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.267847:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 34 pid: 14419 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.267867:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7800/0xbeb05ca97b5f87fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0x769326461023d84 expref: 34 pid: 14419 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.267883:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:2.0:1788271915.267887:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.267923:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.267931:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271915.267961:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271915.268018:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+33:2354:x1875138574410240:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 204us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271915.268025:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00010000:00010000:1.0:1788271915.268148:0:14420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.268156:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271915.268207:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788271915.268211:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788271915.268230:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.268264:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f881a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d92 expref: 33 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.268277:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d92 expref: 32 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.268283:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:1.0:1788271915.268286:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271915.268288:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6edee7e00, rc 0) 00000100:00100000:1.0:1788271915.268314:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+32:14571:x1875138574410112:12345-192.168.201.1@tcp:101:bash.0 Request processed in 5072us (5247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271915.268321:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:0.0:1788271915.274072:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271915.274152:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574410496 00000100:00100000:3.0:1788271915.274163:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574410496 00000100:00100000:3.0:1788271915.274229:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:3.0:1788271915.274240:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+32:14571:x1875138574410496:12345-192.168.201.1@tcp:103:bash.0 00010000:00010000:3.0:1788271915.274263:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788271915.274288:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7e00/0xbeb05ca97b5f8821 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d92 expref: 32 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.274308:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f8813 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d8b expref: 31 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.274319:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6c4f64500) 00010000:00010000:3.0:1788271915.274344:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271915.274403:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+30:14571:x1875138574410496:12345-192.168.201.1@tcp:103:bash.0 Request processed in 165us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271915.274410:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:3.0:1788271915.277347:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271915.277444:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574410624 00000100:00100000:1.0:1788271915.277453:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574410624 00000100:00100000:1.0:1788271915.277507:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:1.0:1788271915.277519:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+30:14571:x1875138574410624:12345-192.168.201.1@tcp:58:bash.0 00010000:00010000:1.0:1788271915.277605:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.277619:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271915.277630:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271915.278591:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271915.278742:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788271915.278808:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788271915.278901:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+30:14571:x1875138574410624:12345-192.168.201.1@tcp:58:bash.0 Request processed in 1383us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271915.278920:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1788271915.281811:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271915.281890:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574410752 00000100:00100000:3.0:1788271915.281900:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574410752 00000100:00100000:3.0:1788271915.281968:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:3.0:1788271915.281979:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+30:14571:x1875138574410752:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271915.281998:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271915.282018:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023d99 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.282071:0:14418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.282082:0:14418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d99 expref: 31 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.282100:0:14418:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.282111:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d99 expref: 31 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.282122:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:3.0:1788271915.282125:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271915.282128:0:14418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d99 expref: 31 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271915.282146:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19a00, rc 0) 00000100:00100000:3.0:1788271915.282205:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+31:14571:x1875138574410752:12345-192.168.201.1@tcp:101:bash.0 Request processed in 227us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271915.282211:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:1.0:1788271915.506721:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab5c3260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586972928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271915.506838:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271915.515353:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586972928 00000100:00100000:0.0:1788271915.515367:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586972928 00000100:00100000:0.0:1788271915.515450:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271915.515461:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586972928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271915.515497:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788271915.515611:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271915.515805:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586972928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 345us (8965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271915.515813:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271915.516691:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab5c3260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586972928:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788271915.566184:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1788271915.566197:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:2.0:1788271915.566205:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:2.0:1788271915.566465:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788271915.698733:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788271916.147027:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788271916.147038:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271916.147085:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788271916.147091:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788271916.147217:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14452:1875138586973056:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788271916.147336:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c6aa0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271916.157187:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14452:1875138586973056:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271916.161872:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271916.162327:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574410880 00000100:00100000:1.0:1788271916.162354:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574410880 00000100:00100000:1.0:1788271916.162446:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1788271916.162459:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14572:x1875138574410880:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788271916.162564:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14572:x1875138574410880:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 Request processed in 107us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271916.162578:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:0.0:1788271916.169169:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.170051:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574411008 00000100:00100000:3.0:1788271916.170066:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574411008 00000100:00100000:3.0:1788271916.170187:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:3.0:1788271916.170198:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14572:x1875138574411008:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788271916.170268:0:14419:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788271916.170392:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14572:x1875138574411008:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 195us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.170400:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:0.0:1788271916.176336:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.176590:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574411136 00000100:00100000:3.0:1788271916.176601:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574411136 00000100:00100000:3.0:1788271916.176760:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:3.0:1788271916.176771:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14572:x1875138574411136:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788271916.176842:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.176859:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.176872:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.176980:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.176988:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.176996:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177021:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177030:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177036:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271916.177080:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788271916.177084:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788271916.177100:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177111:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177116:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177122:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177137:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271916.177142:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177150:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177164:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c4f64300) 00010000:00010000:3.0:1788271916.177167:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271916.177172:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177178:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f8836 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177191:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177196:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177202:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177206:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee19600 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271916.177208:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177213:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177230:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ab6cefc4900) 00010000:00010000:3.0:1788271916.177233:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271916.177235:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177241:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f883d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177256:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177261:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177266:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177270:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271916.177272:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177277:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177284:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:3.0:1788271916.177286:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271916.177289:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.177294:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8844 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.177385:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14572:x1875138574411136:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 615us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.177393:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:0.0:1788271916.187690:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.187902:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574411392 00000100:00100000:2.0:1788271916.187913:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574411392 00000100:00100000:2.0:1788271916.187970:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:2.0:1788271916.187982:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+10:14572:x1875138574411392:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271916.188002:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271916.188024:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f884b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023da0 expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188131:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188146:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188169:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271916.188180:0:16297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788271916.188305:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188313:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188319:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188324:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148a400 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271916.188329:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188337:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188349:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:2.0:1788271916.188352:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271916.188357:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188373:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8852 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188614:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f884b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023da0 expref: 12 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188626:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab6c4f64300) 00010000:00010000:2.0:1788271916.188628:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271916.188633:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f884b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023da0 expref: 12 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.188645:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148be00, rc 0) 00000100:00100000:2.0:1788271916.188746:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+11:14572:x1875138574411392:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 765us (1066us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788271916.188753:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:0.0:1788271916.196821:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.196884:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574411520 00000100:00100000:2.0:1788271916.196904:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574411520 00000100:00100000:2.0:1788271916.196960:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:2.0:1788271916.196971:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6eda29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+11:14572:x1875138574411520:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788271916.197008:0:14420:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788271916.197113:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6eda29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+11:14572:x1875138574411520:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271916.197120:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1788271916.207806:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.210214:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574411776 00000100:00100000:2.0:1788271916.210231:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574411776 00000100:00100000:2.0:1788271916.210909:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:2.0:1788271916.210937:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+11:14572:x1875138574411776:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271916.210959:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271916.210979:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8860 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023da7 expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788271916.211988:0:16297:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1788271916.211998:0:16297:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788271916.212045:0:16297:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788271916.213229:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8867 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.213299:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.213312:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.213536:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8860 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023da7 expref: 14 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.213557:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8867 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023da7 expref: 13 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.213565:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6c4f64800) 00010000:00010000:2.0:1788271916.213568:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271916.213572:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148a400, rc 0) 00000100:00100000:2.0:1788271916.214100:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14572:x1875138574411776:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 3163us (6299us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788271916.214109:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:0.0:1788271916.222199:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271916.225527:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574412032 00000100:00100000:1.0:1788271916.225543:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574412032 00000100:00100000:1.0:1788271916.225622:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:1.0:1788271916.225633:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14572:x1875138574412032:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788271916.225690:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271916.225727:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a400/0xbeb05ca97b5f8867 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023da7 expref: 13 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.225769:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6c4f64800) 00010000:00010000:1.0:1788271916.225780:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271916.225803:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.225816:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.225826:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.225901:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.225909:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.225915:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226186:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226193:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226200:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226206:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271916.226210:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226226:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226664:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:1.0:1788271916.226669:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271916.226673:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226679:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6200/0xbeb05ca97b5f8875 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226689:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226695:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226701:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226705:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee7c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271916.226708:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226714:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226731:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb6fb5d09 (ffff8ab6cb419a00) 00010000:00010000:1.0:1788271916.226733:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271916.226736:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.226753:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee7c00/0xbeb05ca97b5f887c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb6fb5d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271916.226842:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+12:14572:x1875138574412032:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1209us (4652us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271916.226850:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:0.0:1788271916.233869:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.235346:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574412160 00000100:00100000:3.0:1788271916.235359:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574412160 00000100:00100000:3.0:1788271916.235472:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:3.0:1788271916.235483:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+12:14572:x1875138574412160:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271916.235696:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271916.235723:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8883 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023dae expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.235761:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f888a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.235774:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f888a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.235784:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f888a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.235897:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8883 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dae expref: 14 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.235917:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19600/0xbeb05ca97b5f888a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dae expref: 13 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.235926:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:3.0:1788271916.235935:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271916.235939:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee19600, rc 0) 00000100:00100000:3.0:1788271916.236106:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14572:x1875138574412160:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 624us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.236113:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:0.0:1788271916.245619:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.245908:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574412416 00000100:00100000:3.0:1788271916.245918:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574412416 00000100:00100000:3.0:1788271916.245985:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:3.0:1788271916.245996:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14572:x1875138574412416:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271916.246083:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.246102:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.246114:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271916.246842:0:14418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788271916.246854:0:14418:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479428440608ns, next at 480428438154ns, rc = 0 00000004:00010000:3.0:1788271916.246956:0:14418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0ff4582 reply state 000000004cadc7e7 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.246967:0:14418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271916.247069:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+15:14572:x1875138574412416:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1074us (1457us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788271916.247078:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00010000:00010000:2.0:1788271916.251114:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.251131:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.251139:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.251144:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271916.251216:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.251226:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.251305:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:2.0:1788271916.251309:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788271916.251315:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.251321:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f8891 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271916.259378:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.259508:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574412544 00000100:00100000:2.0:1788271916.259518:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574412544 00000100:00100000:2.0:1788271916.259576:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:2.0:1788271916.259587:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+14:14572:x1875138574412544:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271916.259612:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271916.259636:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023db5 expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.259726:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 15 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.259740:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 15 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.259762:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:2.0:1788271916.259765:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271916.259770:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148be00, rc 0) 00000100:00100000:2.0:1788271916.259821:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+15:14572:x1875138574412544:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 236us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271916.259828:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:0.0:1788271916.271047:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.271160:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574412672 00000100:00100000:2.0:1788271916.271170:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574412672 00000100:00100000:2.0:1788271916.271246:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1788271916.271259:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2353:x1875138574412672:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788271916.271821:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2353:x1875138574412672:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 562us (781us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788271916.271830:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00080000:1.0:1788271916.272224:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271916.292084:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.293281:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574412928 00000100:00100000:3.0:1788271916.293295:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574412928 00000100:00100000:3.0:1788271916.293380:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:3.0:1788271916.293391:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+15:14572:x1875138574412928:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271916.293674:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+16:14572:x1875138574412928:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 284us (1600us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788271916.293682:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1788271916.302682:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271916.302777:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574413184 00000100:00100000:1.0:1788271916.302787:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574413184 00000100:00100000:1.0:1788271916.302848:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:1.0:1788271916.302859:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+16:14572:x1875138574413184:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788271916.302989:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+16:14572:x1875138574413184:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 130us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271916.302997:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:1.0:1788271916.306784:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.306875:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574413312 00000100:00100000:2.0:1788271916.306884:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574413312 00000100:00100000:2.0:1788271916.306952:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:2.0:1788271916.306962:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+16:14572:x1875138574413312:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271916.306983:0:16297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271916.307005:0:16297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f889f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023dbc expref: -99 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.307105:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ae00/0xbeb05ca97b5f88a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.307119:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ae00/0xbeb05ca97b5f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.307128:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ae00/0xbeb05ca97b5f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271916.307173:0:16297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788271916.307190:0:16297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ae00/0xbeb05ca97b5f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.307214:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f889f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dbc expref: 18 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.307233:0:16297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ae00/0xbeb05ca97b5f88a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dbc expref: 17 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.307307:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:2.0:1788271916.307310:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271916.307313:0:16297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148ae00, rc 0) 00000100:00100000:2.0:1788271916.307371:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14572:x1875138574413312:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 410us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271916.307378:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:0.0:1788271916.318030:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.318120:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574413440 00000100:00100000:2.0:1788271916.318131:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574413440 00000100:00100000:2.0:1788271916.318193:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:2.0:1788271916.318217:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+6:2353:x1875138574413440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271916.318368:0:15106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271916.318396:0:15106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023dc3 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788271916.318693:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dd2b, blocks: 0x1 00010000:00010000:0.0:1788271916.318717:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=479s v=(0 0) 00010000:00010000:0.0:1788271916.318722:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271916.318732:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 7 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.318752:0:15106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 7 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.318768:0:15106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6c148a800, rc 0) 00000100:00100000:0.0:1788271916.318830:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:2353:x1875138574413440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 615us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271916.318837:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:0.0:1788271916.325512:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271916.325710:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574413696 00000100:00100000:1.0:1788271916.325720:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574413696 00000100:00100000:1.0:1788271916.325776:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:1.0:1788271916.325786:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14572:x1875138574413696:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788271916.325902:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14572:x1875138574413696:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 117us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271916.325910:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:1.0:1788271916.330064:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.330166:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574413824 00000100:00100000:2.0:1788271916.330176:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574413824 00000100:00100000:2.0:1788271916.330242:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:2.0:1788271916.330253:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14572:x1875138574413824:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788271916.375824:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:2.0:1788271916.375856:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788271916.375864:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788271916.375999:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586973184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788271916.376073:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271916.376156:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586973184 00000100:00100000:2.0:1788271916.376163:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586973184 00000100:00100000:2.0:1788271916.376203:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271916.376212:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875138586973184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788271916.376371:0:15835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788271916.376376:0:15835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788271916.376378:0:15835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788271916.376380:0:15835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788271915 -> 1788271915 00002000:00010000:2.0:1788271916.376382:0:15835:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788271916.376457:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875138586973184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 245us (383us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788271916.376464:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788271916.377025:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6ffad3b80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788271916.377034:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875138586973184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788271916.377270:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14572:x1875138574413824:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 47017us (47213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.377280:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:0.0:1788271916.381396:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.381656:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574413952 00000100:00100000:3.0:1788271916.381666:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574413952 00000100:00100000:3.0:1788271916.381760:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:3.0:1788271916.381772:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:2353:x1875138574413952:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788271916.381897:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:2353:x1875138574413952:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 118us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.381905:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1788271916.385082:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271916.385188:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574414208 00000100:00100000:1.0:1788271916.385198:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574414208 00000100:00100000:1.0:1788271916.385377:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1788271916.385389:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14572:x1875138574414208:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788271916.385490:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271916.385669:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148ae00/0xbeb05ca97b5f88a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dbc expref: 13 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.385689:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:1.0:1788271916.385694:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271916.385725:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.385737:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.385747:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271916.385946:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ad3f8fb reply state 00000000a0eea4d2 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271916.385956:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271916.386110:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+14:14572:x1875138574414208:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 723us (1037us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788271916.386118:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1788271916.395913:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.398579:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574414336 00000100:00100000:3.0:1788271916.398595:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574414336 00000100:00100000:3.0:1788271916.398670:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1788271916.398682:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab5c3261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:14572:x1875138574414336:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271916.398699:0:15835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271916.398720:0:15835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023dca expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.398749:0:15835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 8 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.398777:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271916.398782:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271916.398788:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 8 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.398824:0:15835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 8 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.398838:0:15835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 8 pid: 15106 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.398853:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15835:1875138586973312:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271916.398964:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9eabb40 going to sleep for 11 seconds 00010000:00010000:0.0:1788271916.399166:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.399175:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.399181:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.399186:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6000 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:0.0:1788271916.399190:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.399197:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.399213:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:0.0:1788271916.399215:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271916.399220:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.399226:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6000/0xbeb05ca97b5f88b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.403659:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15835:1875138586973312:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271916.403699:0:15835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 8 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.403721:0:15835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18c00, rc 0) 00000100:00100000:3.0:1788271916.403780:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab5c3261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+8:14572:x1875138574414336:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 5100us (7876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.403789:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:0.0:1788271916.411062:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.411342:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574414464 00000100:00100000:3.0:1788271916.411353:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574414464 00010000:00010000:3.0:1788271916.411464:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 8 pid: 15106 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.411603:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:3.0:1788271916.411615:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+8:2354:x1875138574414464:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271916.411632:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271916.411656:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 8 pid: 15106 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.411669:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 8 pid: 15106 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.411694:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1a3fb0/0xbeb05ca97b5f88ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023dc3 expref: 8 pid: 15106 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.411710:0:14403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271916.411714:0:14403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271916.411721:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 7 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.411731:0:14403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 7 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.411768:0:14403:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 7 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.411793:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14403:1875138586973440:192.168.201.1@tcp:105: 00000100:00100000:3.0:1788271916.411867:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6c9eabb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271916.419803:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14403:1875138586973440:192.168.201.1@tcp:105: 00010000:00010000:3.0:1788271916.419831:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271916.419899:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:2354:x1875138574414464:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 8286us (8845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.419910:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1788271916.422852:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.422963:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574414592 00000100:00100000:2.0:1788271916.422975:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574414592 00000100:00100000:2.0:1788271916.423076:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:2.0:1788271916.423087:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:2353:x1875138574414592:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788271916.423305:0:15106:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788271916.423309:0:15106:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788271914 00002000:00010000:2.0:1788271916.423311:0:15106:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788271912 00002000:00010000:2.0:1788271916.423313:0:15106:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788271915 -> 1788271914 00002000:00010000:2.0:1788271916.423315:0:15106:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788271916.423379:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+8:2353:x1875138574414592:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 292us (534us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788271916.423387:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1788271916.426947:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271916.427085:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574414720 00000100:00100000:2.0:1788271916.427095:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574414720 00000100:00100000:2.0:1788271916.427147:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1788271916.427157:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+8:2351:x1875138574414720:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788271916.427203:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.427222:0:15106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 8 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.427323:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271916.427328:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271916.427345:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.427384:0:15106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 8 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.427398:0:15106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 8 pid: 15835 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271916.427628:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15106:1875138586973568:192.168.201.1@tcp:104: 00000100:00100000:2.0:1788271916.427712:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271916.434148:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.434277:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574414848 00000100:00100000:3.0:1788271916.434287:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574414848 00010000:00010000:3.0:1788271916.434326:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 9 pid: 15835 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.434370:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:3.0:1788271916.434380:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:2354:x1875138574414848:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271916.434405:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271916.434470:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 9 pid: 15835 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.434484:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 9 pid: 15835 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.434507:0:14405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271916.434511:0:14405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271916.434517:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.434541:0:14405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.434563:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271916.434610:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fdae9dd-1719-4c58-a499-19ec5d9d843b+9:2354:x1875138574414848:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 231us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.434617:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00010000:00010000:0.0:1788271916.434950:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063f17037/0xbeb05ca97b5f88bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0x769326461023dca expref: 8 pid: 15835 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271916.434978:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ffad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15106:1875138586973568:192.168.201.1@tcp:104: 00010000:00010000:0.0:1788271916.434999:0:15106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435009:0:15106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435016:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435043:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435051:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435059:0:15106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435066:0:15106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148b400 already unused, calling callback (ffffffffc1420230) 00010000:00010000:0.0:1788271916.435070:0:15106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435078:0:15106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435096:0:15106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271916.435104:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090d272ba/0xbeb05ca97b5f88c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271916.435166:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:2351:x1875138574414720:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 8010us (8228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271916.435174:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1788271916.448198:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.448341:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574415104 00000100:00100000:3.0:1788271916.448351:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574415104 00000100:00100000:3.0:1788271916.448459:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:3.0:1788271916.448470:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+13:14572:x1875138574415104:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788271916.448550:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.448568:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.448580:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.448824:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.448835:0:14419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 14 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.448843:0:14419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.448882:0:14419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 14 pid: 16297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.448906:0:14419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 14 pid: 16297 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.448920:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586973696:192.168.201.1@tcp:104: 00000100:00100000:3.0:1788271916.448998:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6e59b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271916.456865:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee24d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586973696:192.168.201.1@tcp:104: 00010000:00010000:3.0:1788271916.456908:0:14419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271916.458569:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.458744:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574415232 00000100:00100000:3.0:1788271916.458753:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574415232 00010000:00010000:3.0:1788271916.458792:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 15 pid: 16297 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271916.458834:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1788271916.458843:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+15:2354:x1875138574415232:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271916.458858:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271916.458864:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 15 pid: 16297 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.458876:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 15 pid: 16297 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.458930:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148be00/0xbeb05ca97b5f8898 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0x769326461023db5 expref: 15 pid: 16297 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.458947:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:3.0:1788271916.458951:0:14403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.458962:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.458969:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.458991:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271916.459043:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+14:2354:x1875138574415232:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 201us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.459050:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00010000:00010000:1.0:1788271916.460129:0:14419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.460139:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271916.460342:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788271916.460547:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788271916.460594:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788271916.460680:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14419:1875138586973824:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788271916.460776:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271916.460811:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ede38300 going to sleep for 11 seconds 00000100:00100000:2.0:1788271916.460986:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586973824 00000100:00100000:2.0:1788271916.460993:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586973824 00000100:00100000:2.0:1788271916.461032:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271916.461041:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14419:x1875138586973824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788271916.461121:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14419:x1875138586973824:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271916.461129:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271916.461212:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14419:1875138586973824:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788271916.463963:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788271916.464054:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6ee3b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14419:1875138586973952:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788271916.464117:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271916.464255:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ca344000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271916.464787:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586973952 00000100:00100000:3.0:1788271916.464795:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586973952 00000100:00100000:3.0:1788271916.464892:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271916.464902:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14419:x1875138586973952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788271916.465104:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14419:x1875138586973952:12345-0@lo:1000:mdt00_001.0 Request processed in 202us (986us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788271916.465111:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271916.465185:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6ee3b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14419:1875138586973952:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788271916.465225:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465245:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465253:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465259:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271916.465263:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465271:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465289:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:1.0:1788271916.465293:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271916.465297:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465317:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465348:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465356:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465362:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465366:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6edee6800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:1.0:1788271916.465369:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465375:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465383:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:1.0:1788271916.465385:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271916.465392:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d99 expref: 17 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465445:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d99 expref: 17 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465637:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d99 expref: 17 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.465705:0:14419:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee19a00/0xbeb05ca97b5f882f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023d99 expref: 17 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271916.465719:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6f7cfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586974080:192.168.201.1@tcp:105: 00000100:00100000:1.0:1788271916.465794:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6ede383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271916.477466:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.477585:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574415360 00000100:00100000:3.0:1788271916.477595:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574415360 00000100:00100000:3.0:1788271916.477651:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:3.0:1788271916.477662:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+18:14571:x1875138574415360:12345-192.168.201.1@tcp:49:bash.0 00000100:00100000:3.0:1788271916.477814:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+18:14571:x1875138574415360:12345-192.168.201.1@tcp:49:bash.0 Request processed in 153us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.477822:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:1.0:1788271916.480359:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6f7cfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14419:1875138586974080:192.168.201.1@tcp:105: 00010000:00010000:1.0:1788271916.480391:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.480877:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6edee6800/0xbeb05ca97b5f8828 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481080:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481095:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481126:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481137:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481143:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481150:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481155:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c148a800 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271916.481159:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481165:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481176:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:2.0:1788271916.481178:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271916.481181:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481186:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c148a800/0xbeb05ca97b5f88d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481197:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481202:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481214:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481219:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:2.0:1788271916.481222:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481241:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481250:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:2.0:1788271916.481253:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271916.481256:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.481261:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271916.481850:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ffad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14572:x1875138574415104:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 33377us (33656us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788271916.481863:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000020:00080000:2.0:1788271916.481869:0:14419:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788271916.482907:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788271916.482915:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271916.482946:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788271916.482952:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788271916.485771:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.486035:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574415488 00000100:00100000:3.0:1788271916.486048:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574415488 00000100:00100000:3.0:1788271916.486111:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1788271916.486121:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+7:14571:x1875138574415488:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1788271916.486139:0:15105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271916.486160:0:15105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3238f43/0xbeb05ca97b5f88de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023dd1 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271916.486187:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a96dd2a, atime: 0x6a96dd28, ctime: 0x6a96dd2a, blocks: 0x1 00010000:00010000:3.0:1788271916.486208:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788271916.486213:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271916.486223:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3238f43/0xbeb05ca97b5f88de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dd1 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.486249:0:15105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3238f43/0xbeb05ca97b5f88de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dd1 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.486262:0:15105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18400, rc 0) 00000100:00100000:3.0:1788271916.486326:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+8:14571:x1875138574415488:12345-192.168.201.1@tcp:101:bash.0 Request processed in 206us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271916.486333:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1788271916.489369:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.489628:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574415744 00000100:00100000:3.0:1788271916.489638:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574415744 00000100:00100000:3.0:1788271916.489717:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1788271916.489727:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+17:14572:x1875138574415744:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788271916.490368:0:14421:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788271916.490581:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788271916.490624:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.490642:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.490654:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.490662:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.490668:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.490674:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.490688:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271916.490837:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271916.490844:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.490852:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18800 already unused, calling callback (ffffffffc1420230) 00010000:00010000:1.0:1788271916.490856:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.490863:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.490876:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab6cefc4900) 00010000:00010000:1.0:1788271916.490879:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788271916.490894:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.490910:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88e5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271916.490922:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271916.490923:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271916.490925:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271916.491280:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:14572:x1875138574415744:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 1549us (1916us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788271916.491290:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000020:00080000:3.0:1788271916.491296:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788271916.494854:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271916.496382:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574416000 00000100:00100000:0.0:1788271916.496445:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574416000 00000100:00100000:0.0:1788271916.496511:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1788271916.496522:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+19:14571:x1875138574416000:12345-192.168.201.1@tcp:35:bash.0 00000001:00080000:0.0:1788271916.496794:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1788271916.496915:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1788271916.497020:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+22:14571:x1875138574416000:12345-192.168.201.1@tcp:35:bash.0 Request processed in 498us (2176us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788271916.497038:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000020:00080000:0.0:1788271916.497043:0:14422:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788271916.601084:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.601186:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574416256 00000100:00100000:3.0:1788271916.601196:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574416256 00000100:00100000:3.0:1788271916.601258:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:3.0:1788271916.601269:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+22:14582:x1875138574416256:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1788271916.601311:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271916.601340:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x769326461023dd8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271916.601737:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788271916.601916:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dd8 expref: 24 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.601932:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab6cb419500) 00010000:00010000:2.0:1788271916.601940:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271916.601947:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18800/0xbeb05ca97b5f88ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0x769326461023dd8 expref: 24 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271916.601961:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab6dee18800, rc 0) 00000100:00100000:2.0:1788271916.602036:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+23:14582:x1875138574416256:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 768us (961us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788271916.602043:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:2.0:1788271916.606035:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271916.606121:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574416384 00000100:00100000:3.0:1788271916.606134:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574416384 00000100:00100000:3.0:1788271916.606196:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:3.0:1788271916.606206:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+23:14582:x1875138574416384:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:3.0:1788271916.606375:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.606391:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.606408:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.606572:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.606580:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.606588:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.607135:0:16297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.607146:0:16297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.607161:0:16297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271916.607203:0:16297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.607216:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.607223:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608001:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608009:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6dee18c00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271916.608013:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608021:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608036:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab6cb419100) 00010000:00010000:3.0:1788271916.608039:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271916.608044:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608050:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6dee18c00/0xbeb05ca97b5f88fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608064:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608081:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608087:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608092:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0031a00 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271916.608095:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608101:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608109:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab6cefc4700) 00010000:00010000:3.0:1788271916.608111:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271916.608113:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608119:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0031a00/0xbeb05ca97b5f8901 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608135:0:16297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608139:0:16297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608145:0:16297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608150:0:16297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab6c0030200 already unused, calling callback (ffffffffc1e2a4f0) 00010000:00010000:3.0:1788271916.608159:0:16297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608165:0:16297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608173:0:16297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab6cb419e00) 00010000:00010000:3.0:1788271916.608175:0:16297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271916.608178:0:16297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271916.608184:0:16297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab6c0030200/0xbeb05ca97b5f8908 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16297 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271916.609189:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+23:14582:x1875138574416384:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 2978us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271916.609199:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:1.0:1788271916.618894:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271916.618994:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574416640 00000100:00100000:0.0:1788271916.619004:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574416640 00000100:00100000:0.0:1788271916.619063:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1788271916.619072:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+23:14582:x1875138574416640:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1788271916.619893:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+24:14582:x1875138574416640:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 808us (1007us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788271916.619904:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00010000:00010000:3.0:1788271916.723307:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271917.042963:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586974336:0@lo:400:kworker.0 00000100:00100000:3.0:1788271917.042968:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586974592:0@lo:400:kworker.0 00000100:00100000:0.0:1788271917.043052:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586974208:0@lo:400:kworker.0 00000100:00100000:2.0:1788271917.043909:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586974464:0@lo:400:kworker.0 00000100:00100000:3.0:1788271917.054147:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271917.054250:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586974592 00000100:00100000:3.0:1788271917.054259:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586974592 00000100:00100000:3.0:1788271917.054307:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271917.054316:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586974592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271917.054377:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875138586974592:12345-0@lo:400:kworker.0 Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271917.054384:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271917.054444:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875138586974592:0@lo:400:kworker.0 00000100:00100000:0.0:1788271917.055898:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271917.055939:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586974208 00000100:00100000:0.0:1788271917.055946:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586974208 00000100:00100000:0.0:1788271917.055989:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788271917.056000:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:3281:x1875138586974208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271917.056049:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b79826ef-d055-4784-972d-a5e369371347+19:3281:x1875138586974208:12345-0@lo:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271917.056057:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271917.056209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271917.056302:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586974336 00000100:00100000:1.0:1788271917.056306:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586974336 00000100:00100000:1.0:1788271917.056346:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788271917.056353:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6f7cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586974336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271917.056389:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6f7cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875138586974336:12345-0@lo:400:kworker.0 Request processed in 37us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271917.056395:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788271917.056424:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271917.057359:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271917.057550:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b79826ef-d055-4784-972d-a5e369371347:3281:1875138586974208:0@lo:400:kworker.0 00000100:00100000:0.0:1788271917.057564:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586974720:0@lo:400:kworker.0 00000100:00100000:0.0:1788271917.057601:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271917.057714:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875138586974336:0@lo:400:kworker.0 00000100:00100000:2.0:1788271917.057722:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586974848:0@lo:400:kworker.0 00000100:00100000:2.0:1788271917.057747:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271917.057786:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586974720 00000100:00100000:2.0:1788271917.057792:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586974720 00000100:00100000:2.0:1788271917.057833:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586974848 00000100:00100000:2.0:1788271917.057836:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586974848 00000100:00100000:2.0:1788271917.057859:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271917.057867:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586974720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271917.057925:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875138586974720:12345-0@lo:400:kworker.0 Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271917.057932:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271917.057966:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271917.057972:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586974848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271917.058005:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875138586974848:12345-0@lo:400:kworker.0 Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271917.058011:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271917.058035:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875138586974848:0@lo:400:kworker.0 00000100:00100000:0.0:1788271917.059209:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6c57c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586974976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271917.059339:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788271917.059548:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271917.059565:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586974464 00000100:00100000:1.0:1788271917.059572:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586974464 00000100:00100000:1.0:1788271917.059621:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788271917.059631:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586974464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271917.059686:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586974464:12345-0@lo:400:kworker.0 Request processed in 56us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271917.059691:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138586974976 00000100:00100000:1.0:1788271917.059696:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271917.059698:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138586974976 00000100:00080000:1.0:1788271917.059719:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271917.059740:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271917.059751:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586974976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271917.059765:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586974464:0@lo:400:kworker.0 00002000:00000024:3.0:1788271917.059788:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788271917.059830:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6ee3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875138586974976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271917.059837:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271917.059855:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875138586974976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271917.059910:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6c57c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875138586974720:0@lo:400:kworker.0 00010000:00010000:1.0:1788271917.753507:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271918.049287:0:16687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1788271918.199542:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1788271918.199632:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574416768 00000100:00100000:3.0:1788271918.199651:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574416768 00000100:00100000:3.0:1788271918.199753:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:3.0:1788271918.199766:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6edd00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2354:x1875138574416768:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1788271918.199882:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6edd00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff4cb4ac-4a80-4ef0-8b63-c00ed980b89e+13:2354:x1875138574416768:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 118us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271918.199890:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:2.0:1788271918.208009:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271918.208058:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1788271918.208198:0:16297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574416896 00000100:00100000:0.0:1788271918.208209:0:16297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574416896 00000100:00100000:0.0:1788271918.208279:0:16297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:0.0:1788271918.208289:0:16297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+24:2352:x1875138574416896:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1788271918.208371:0:16297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fdae9dd-1719-4c58-a499-19ec5d9d843b+24:2352:x1875138574416896:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 84us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271918.208387:0:16297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00080000:2.0:1788271918.208492:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271918.209139:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574417024 00000100:00100000:1.0:1788271918.209147:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574417024 00000100:00100000:1.0:1788271918.209233:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1788271918.209242:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+8:2351:x1875138574417024:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271918.209285:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fdae9dd-1719-4c58-a499-19ec5d9d843b+8:2351:x1875138574417024:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 45us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271918.209292:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00080000:2.0:1788271918.209612:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271918.212024:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271918.212091:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271918.212229:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1788271918.212257:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1788271918.212306:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574417152 00000100:00100000:1.0:1788271918.212315:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574417152 00000100:00100000:1.0:1788271918.212366:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574417408 00000100:00100000:1.0:1788271918.212368:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574417408 00000100:00100000:1.0:1788271918.212404:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1788271918.212430:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2352:x1875138574417152:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271918.212494:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fdae9dd-1719-4c58-a499-19ec5d9d843b+5:2352:x1875138574417152:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 82us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271918.212502:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1788271918.212517:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1788271918.212522:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574417408:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271918.212542:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574417408:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 20us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271918.212547:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1788271918.213193:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574417280 00000100:00100000:1.0:1788271918.213273:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138574417536 00000100:00100000:1.0:1788271918.213280:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574417536 00000100:00100000:1.0:1788271918.213319:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1788271918.213327:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574417536:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1788271918.213390:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+5:2352:x1875138574417536:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 62us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271918.213399:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:2.0:1788271918.213647:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138574417280 00000100:00100000:2.0:1788271918.213695:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:2.0:1788271918.213702:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6c57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2352:x1875138574417280:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1788271918.213745:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6c57c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c243dd0-b761-4246-9c20-eb0b6359bc38+6:2352:x1875138574417280:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 43us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271918.213752:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00080000:2.0:1788271918.213771:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271918.213775:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271918.213778:0:14414:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788271918.639950:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1788271918.639968:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1788271918.639978:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:0.0:1788271918.773494:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29250 lines, 29250 kept, 0 dropped, 0 bad.